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Introduction 


This book is based on several courses that I taught at the University of Cincinnati. 
Chapters [IH4 are based on the course “Differential Equations” for sophomores in sci- 
ence and engineering. Only some basic concepts of multivariable calculus are used 
(functions of two variables and partial derivatives), and they are reviewed in the text. 
Chapters [7 and B| are based on the course “Fourier Series and PDE”, and they should 
provide a wide choice of material for the instructors. Chapters [] and | were used in 
graduate ODE courses, providing most of the needed material. Some of the sections of 
this book are outside of the scope of usual courses, but I hope they will be of interest 
to students and instructors alike. The book has a wide range of problems. 

I attempted to share my enthusiasm for the subject and write a textbook that stu- 
dents will like to read. While some theoretical material is either quoted or just men- 
tioned without proof, my goal was to show all of the details when doing problems. I 
tried to use plain language and not to be too wordy. I think that an extra word of expla- 
nation has often as much potential to confuse a student as to be helpful. I also tried not 
to overwhelm students with new information. I forgot who said it first: “One should 
teach the truth, nothing but the truth, but not the whole truth.” 

I hope that experts will find this book useful as well. It presents several important 
topics that are hard to find in the literature: Massera’s theorem, Lyapunov’s inequality, 
Picone’s form of Sturm’s comparison theorem, the “sideways” heat equation, periodic 
population models, the “hands on” numerical solution of nonlinear boundary value 
problems, the isoperimetric inequality, etc. The book also contains new exposition of 
some standard topics. We have completely revamped the presentation of the Frobenius 
method for the series solution of differential equations, so that the “regular singular 
points” are now hopefully in the past. In the proof of the existence and uniqueness 
theorem, we replaced the standard Picard iterations with monotone iterations, which 
should be easier for students to absorb. There are many other fresh touches throughout 
the book. The book contains a number of interesting nonstandard problems, including 
some original ones, published by the author over the years in the Problem Sections 
of SIAM Review, Electronic Journal of Differential Equations, and other journals. All 
of the challenging problems are provided with hints, making them easy to solve for 
instructors. We use an asterisk (or star) to identify nonstandard problems and sections. 

How important are differential equations? Here is what Isaac Newton said: “It 
is useful to solve differential equations.” And what he knew was just the beginning. 
Today differential equations are used widely in science and engineering. This book 
presents many applications as well. Some of these applications are very old, like the 
tautochrone problem considered by Christian Huygens in 1659. Some applications, 


xi 
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like when a drone is targeting a car, are modern. Differential equations are also a beau- 
tiful subject, which lets students see calculus “in action”. 

I attempted to start each topic with simple examples, to keep the presentation fo- 
cused, and to show all of the details. I think this book is suitable for self-study. How- 
ever, instructor can help in many ways. He (she) will present the subject with the 
enthusiasm it deserves, draw more pictures, talk about the history, and tell jokes that 
supplement the lame ones in the book. 

Iam very grateful to the MAA Book Board, including Steve Kennedy, Stan Seltzer, 
and the whole group of anonymous reviewers, for providing me with detailed lists of 
corrections and suggested changes. Their help was crucial in making considerable 
improvements to the manuscript. 

It is a pleasure to thank Ken Meyer and Dieter Schmidt for constant encourage- 
ment while I was writing this book. I also wish to thank Ken for reading the entire 
book and making a number of useful suggestions, like doing Fourier series early, with 
applications to periodic vibrations and radio tuning. I wish to thank Roger Chalkley, 
Tomasz Adamowicz, Dieter Schmidt, and Ning Zhong for a number of useful com- 
ments. Many useful comments also came from students in my classes. They liked the 
book, and that provided me with the biggest encouragement. 


First-Order Equations 


First-order equations occur naturally in many applications, making them an important 
object to study. They are also used throughout this book and are of great theoretical 
importance. Linear first-order equations, the first class of the equations we study, turns 
out to be of particular importance. Separable, exact, and homogeneous equations are 
also used throughout the book. Applications are made to population modeling and to 
various physical and geometrical problems. If a solution cannot be found by a formula, 
we prove that solution still exists and indicate how it can be computed numerically. 


1.1 Integration by Guess-and-Check 


Many problems in differential equations end with a computation of an integral. One 
even uses the term “integration of a differential equation” instead of “solution”. We 
need to be able to compute integrals quickly, which can be done by using the approach 
of this section. For example, one can write down 


[ee dx = x3e* — 3x7e* + 6xe* — 6e* +¢ 


very quickly, avoiding three integrations by parts. 
Recall the product rule 


(fg) = fe' + f'g. 


Example 1.1.1. f xe* dx. 
We need to find the function, with the derivative equal to xe*. If we try a guess: 
xe*, then its derivative 
(xe*) = xe* + e* 
has an extra term e*. To remove this extra term, we subtract e* from the initial guess, 
so that 


[rtdeaxet ete 


By differentiation, we verify that this is correct. Of course, integration by parts may 
also be used. 
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Example 1.1.2. {x cos 3x dx. 
Starting with the initial guess =x sin 3x, with the derivative equal to x cos 3x + 


. sin 3x, we compute 
5 eee 1 
x cos 3xdx = 3* sin 3x + 9 cos 3x +c. 


7 ine 1 7 2 
Example 1.1.3. f) x cos3xdx = [=x sin 3x + 5 £08 3x|[, Sei 


We see that the initial guess is the product f(x)g(x), chosen in such a way that 
f(x)g' (x) gives the integrand. 


Example 1.1.4. f{ xe~* dx. 


Starting with the initial guess — ~xe~5 


, we compute 


1 1 
xe dx =—=—xe-* =e + ¢; 
| 5 a 
Example 1.1.5. fx? sin 3x dx. 
The initial guess is — =x? cos 3x. Its derivative 


, 


(-32 cos 3x) = x* sin 3x — =x cos 3x 


2 . : 1 
has an extra term — 5% cos 3x. To remove this term, we modify our guess: — 5x cos 3x+ 


Du * eer 
a sin 3x. Its derivative 


, 


(-32 cos 3x + sx sin 3x) = x7 sin 3x + ; sin 3x 
still has an extra term ; sin 3x. So we make the final adjustment 


1 2 2 
[2 sin 3xdx = — 3X? cos 3x of 9% sin 3x + 57 C08 3x +¢. 


This is easier than integrating by parts twice. 


Example 1.1.6. {xv x? + 4dx. 
1/2 
We begin by rewriting the integral as f x (xe +4)" dx. Oneusually computes this 
integral by a substitution u = x? + 4, with du = 2x dx. Forgetting a constant multiple 
for now, the integral becomes / u/? du. Ignoring a constant multiple again, this eval- 


: occ E ere 3/2 
uates to u?/?, Returning to the original variable, we have our initial guess (x? +4)". 


Differentiation 


d ; > 3/2 2 1/2 
rraG +4)" = 3x(x?+4) 
gives us the integrand with an extra factor of 3. To fix that, we multiply the initial guess 


1 
by . 


[oe +4dx = s(x? ay? +c. 
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1 
Example 1.1.7. /{ TEN EEN 
Instead of using partial fractions, let us try to split the integrand as 
1 i 
x24+1 x244° 


This is off by a factor of 3. The correct formula is 


1 = 1 1 ) 
(x2 +1)(x2+4)” 3\x241 x244/)" 
Then 


1 -1 1 1X 
= -tan” x—-<tan zt 


| 
lames ae 


Sometimes one can guess the splitting twice, as in the following case. 


Example 1.1.8. /{ _ = dx 


x2(1—x2) 
ee: ee aa OF 1 Soe ore 
x2(1— x2) x2 © 1—-x2 7 x2 (1 — x) tx) x? 21-x  214+x° 


Then (for |x| < 1) 


1 1 #1 1 
[sq Eo nd - + Fn td) +e 


1.2 First-Order Linear Equations 


Background. Suppose we need to find a function y(x) so that 
y'(x) =x. 


We have a differential equation, because it involves a derivative of the unknown func- 
tion. This is a first-order equation, as it only involves the first derivative. The solution 


is, of course, 
re 
yYx)= > +6, (ia) 


where c is an arbitrary constant. We see that differential equations have infinitely many 
solutions. The formula (1.2.1) gives us the general solution. Then we can select the 
solution that satisfies an extra initial condition. For example, for the problem 


YiX)=x, 
(12) 
yO) = 5, 
we begin with the general solution given in formula (1.2.1) and then evaluate it atx = 0: 
y(0) =c=5. 


So that c = 5, and the solution of the problem ({1.2.2) is 


2 
x 
V(x) = oi ee 
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The problem is an example of an initial value problem. If the variable x repre- 
sents time, then the value of y(x) at the initial time x = 0 is prescribed to be 5. The 
initial condition may be prescribed at other values of x, as in the following example: 


y=y, 
y(1) = 2e. 


Here the initial condition is prescribed at x = 1, where e denotes the Euler number 
e © 2.718. Observe that while y and y’ are both functions of x, we do not spell this out. 
This problem can also be solved using calculus. Indeed, we are looking for a function 
y(x), with the derivative equal to y(x). This is a property of the function e* and its 
constant multiples. The general solution is 


y(x) = ce*, 
and the initial condition gives 
y(1) = ce = 2e, 
so that c = 2. The solution is then 
y(x) = 2e*. 


We see that the main effort is in finding the general solution. Selecting c, to satisfy 
the initial condition, is usually easy. 
Recall from calculus that 


d 
ae = e8) 9'(x), 


In case g(x) is an integral, we have 


ef ods = p(xjef Pm) ax, (1.2.3) 


because the derivative of the integral { p(x) dx is p(x). 


1.2.1 The Integrating Factor. Let us find the general solution of the important 
class of equations 
y' + poy = g(x), (1.2.4) 
where p(x) and g(x) are given functions. This is a linear equation, because y’ + p(x)y 
is a linear combination of the unknown functions y and y’, for each fixed x. 
Calculate the function 
p(x) = ef p(x) dx 


and its derivative 


u(x) = p(xjel PO 4% = p(x). (1.2.5) 
We now multiply the equation by u(x), giving 
My’ + p(x)uy = ug(x). (1.2.6) 


Let us use the product rule and the formula (1.2.5) to calculate the derivative 


d , if u 
qx WY) = Hy + HY = BY" + POOKY. 
So that we may rewrite the equation in the form 


d 
Fy HY] = Hg(e). (1.2.7) 
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This relation allows us to compute the general solution. Indeed, we know the function 
on the right. By integration, we express u(x) y(x) = f u(x)g(x) dx and then solve for 


yx). 
In practice one needs to memorize the formula for the integrating factor u(x) and 
the form of our equation ({1.2.4). When computing j«(x), we shall always take 


the constant of integration to be zero, c = 0, because the method works for any c. 
Example 1.2.1. Solve 
y'+2xy=x, 
y(0) = 2. 
Here p(x) = 2x, and g(x) = x. Compute 
u(x) = ef 2xdx — eo’. 
The equation ({1.2.7) takes the form 
d 2 2 
ax [ex y = xe. 
Integrate both sides, and then perform integration by a substitution u = x? (or use 
guess-and-check) 
1 
ey = pw dx = al +¢. 
Solving for y gives 
1 
y(x) = at ce-x 
From the initial condition 4 
y(0) = 2 +c=2, 


so that c = -. 


Answer. y(x) = : + se. 


Example 1.2.2. Solve 


yt *y =cos2t,  y(m/2)=1. 


Here the independent variable is t, y = y(t), but the method is, of course, the same. 
Compute (for t > 0) 


1 
u(t) = af 1% = elnt =f, 


and then by (1.2.7) 

d 

ai [ty] = tcos2t. 
Integrate both sides and perform integration by parts: 


1 1 
ty= J teos2ear = 3f sin 2t + 7 cos2t +c. 


Divide by t: 
lcos2t c 


1 
t)= =sin2t+— : 
y(t) 5 sin +75 ; a 
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The initial condition gives 


Solve for c (multiplying by 77/2): 
1 
c=7/2+ 2 


and the solution is 


m/2+ : 
1. 1 cos 2t 4 

Wt) = 5 sin 2t + 7—— ; 
The solution y(t) defines a curve, called the integral curve, for this intial value prob- 
lem. The initial condition tells us that y = 1 when t = 7/2, so that the point (77/2, 1) 
lies on the integral curve. What is the maximal interval on which the solution is 
valid? L.e., starting with the initial point t = 77/2, how far can we continue the solution 
to the left and to the right of the initial point? We see from that the maximal 
interval is (0, co). As t tends to 0 from the right, y(t) tends to +00. At t = 0, the solution 


y(t) is undefined. 


(1.2.8) 


Example 1.2.3. Solve 


dy 
xs, + 2y = sinx, y(—7) = —2. 


Here the equation is not in the form (1.2.4), for which the theory applies. We divide 
the equation by x: 

dy 2. _ sinx 

dx xx” . 
sin x 


Now the equation is in the right form, with p(x) = “ and g(x) = _ Using the 
properties of logarithms, compute 


2 
u(x) = ef e™ = init = elnx’ = x2, 


And then 


£ [x?y] = eas = xsinx. 
Integrate both sides and perform integration by parts: 


y= [ ssinxax =—xcosx+sinx +¢, 


giving us the general solution 


cosx  sinx c 
x2 x2" 


yx) = — 


The initial condition implies 


1 c 


Solve for c: 
c= 277 +7. 


cosx . sinx | —2n?+4+7 

x2 x 
(that is how far it can be continued to the left and to the right, starting from the initial 
point x = —7z). 


Answer. y(x) = — . This solution is valid on the interval (—oo, 0) 
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Example 1.2.4. Solve 
dy __1 2 
dx” y—x’ W)= 0: 


We have a problem: not only is this equation not in the right form, this is a nonlinear 


equation, because —_ is not a linear function of y (it is not of the form ay + b, for any 


y-x 
fixed x). We need a little trick. Let us pretend that dy and dx are numbers and take the 
reciprocals of both sides of the equation, getting 


dx _ 

rie daa 
or 

dx - 

ayn t=? 


Let us now think of y as an independent variable and of x as a function of y, x = x(y). 
Then the last equation is linear, with p(y) = 1 and g(y) = y. We proceed as usual: 
u(y) = ef 14Y = eY, and 
d 
— [ex] = yey 
rf [e’x] = ye’. 
Integration gives 
ex = [ve ay = ye? 0 +6 


and solving for x we obtain 


x(y)=y—l+ce’. 


Figure 1.1. The integral curve x = y—1 + 2e7Y, 
with the initial point (1,0) marked. 
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To find c, we need an initial condition. The original initial condition tells us that y = 0 
for x = 1. For the inverse function x(y) this translates to x(0) = 1, so that c = 2. 


Answer. x(y) = y — 1+ 2e7 (see Figure [I.1). 


Rigorous justification of this method is based on the formula for the derivative of 
the inverse function, which we recall next. Let y = y(x) be some function, and let 
Vo = W(X). Let x = x(y) be its inverse function. Then x9 = x(j), and we have 


dx 1 


dy : 
(Xx 
#0) 


1.3 Separable Equations 


Background. Suppose we have a function F(y) and y in turn depends on x, y = y(x), 
so that, in effect, F depends on x. To differentiate F with respect to x, we use the chain 
rule from calculus: 


d a dy 

=F) = Foe). 
The Method. Given two functions F(y) and G(x), let us use the corresponding lower 
case letters to denote their derivatives, so that F’(y) = f(y) and G’(x) = g(x), and 


correspondingly f{ f(y)dy = F(Qy) +c, f g(x) dx = G(x) +c. Our goal is to solve the 
equation 


fo) Z = ao. (1.3.1) 


This is a nonlinear equation. 
Using the upper case functions, this equation becomes 


a ae 
F Os = G'(x). 
By the chain rule, we rewrite this as 


d d 
a) = qx CO) 
If derivatives of two functions are the same, these functions differ by a constant, so that 
F(y) = G(x) +c. (1.3.2) 


This gives the desired general solution! If one is lucky, it may be possible to solve this 
relation for y as a function of x. If not, maybe one can solve for x as a function of y. If 
both attempts fail, one can use a computer implicit plotting routine to draw the integral 


curves, given by ({1.3.2). 
We now describe a simple procedure, which leads from the equation (1.3.1) to its 


solution ({1.3.2). Let us pretend that “ is not a notation for the derivative, but a ratio 
x 
of two numbers dy and dx. Clearing the denominator in (1.3.1), 


fy) dy = g(x) dx. 
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We have separated the variables, everything involving y is now on the left, while x 
appears only on the right. Integrate both sides: 


| fQ) dy = i, g(x) dx, 


which gives us immediately the solution (1.3.2). 


Example 1.3.1. Solve 


dy _ 2 
in 7x0 +9). 


To separate the variables, we multiply by dx and divide by y” + 9 


dy 
[x5 dy = [ sae. 
So that the general solution is 
y 


I arctan — = Le +c 
3 3. 2 : 


which can be solved for y: 
y= stan (32x? + 3c) - stan (3x? + c). 


In the last step we replaced 3c, which is an arbitrary constant, by c. 


Example 1.3.2. Solve 

(xy? + x) dx +e*dy =0. 
This is an example of a differential equation, written in differentials. (Dividing through 
by dx, we can put it into a familiar form xy? +x+e* ~ = 0, although there is no need 


to do that.) 
By factoring, we are able to separate the variables: 


e* dy = —x(y” + 1) dx, 
dy _ ay 
/ y+i = - [xe dx, 
tan} y=xe*+e* +0. 
Answer. y(x) = tan (xe~* + e~* +c). 


Example 1.3.3. Find all solutions of 


We separate the variables and obtain 


dy 1 1 
[B-f =a ne VS Pr eae 


However, division by y? is possible only if y2 # 0. The case when y* = 0 leads to 
another solution: y = 0. 


Answer. y = -—, andy =0. 
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When performing a division by a nonconstant expression, one needs to check if any 
solutions are lost, when this expression is zero. (If you divide the quadratic equation 
x(x — 1) = 0 by x, the root x = 0 is lost. If you divide by x — 1, the root x = 1 is lost.) 

Recall the fundamental theorem of calculus: 


af fOde= 100 


for any constant a. The integral f i f(t) dt gives us an antiderivative of f(x), so that we 
may write 


[rear= | soar nas 


Here we can let c be an arbitrary constant and a fixed, or the other way around. 


Example 1.3.4. Solve 


Separation of variables 


d 
[ae [os 


gives on the right an integral that cannot be evaluated in elementary functions. We 
shall change it to a definite integral, as in (1.3.3). It is convenient to choose a = 1, 
because the initial condition is given at x = 1: 


When x = 1, we have y = —2, which gives c = ; (using that 1 e dt = 0). 


aaa For any x, the integral i ef dt canbe quickly computed 
1¢ 2 
by a numerical integration method, for example, by using the trapezoidal rule. 


Answer. y(x) = — 


1.3.1 Problems. 
I. Integrate by Guess-and-Check. 
1. f xe* dx. 


5x 5x 


e 
Answer. x— — — +c. 
5 25 


2. f x cos 2x dx. 


sin 2x cos 2x 
Answer. a + a +c. 


3. f(2x + 1) sin 3x dx. 


cos 3x 
3 


Answer. —(2x + 1) + ; sin 3x +c. 
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4. 


10. 


11. 


12. 


13. 


14. 


St ae 


Saf 


1 
[xe 2” dx. 


Answer. e~*/2(—4 — 2x) +c. 


of eer de 


Answer, —x2e~* — 2xe~* — 2e-* +c. 


. f x? cos 2x dx. 


1 1 TY 
Answer. 5x cos 2x + (5x _ =) sin 2x +c. 


if ade: 


Vx241 


Answer. Vx2+1+¢. 


1 x 


dx. 


Answer. V2 -—1. 


1 
(x2+1)(x2+9) 


1 = 1 oom ie, 2 
Answer, = tan7'x — —tan7-!= +c. 
8 24 3 


Be 
f (x2+1)(x2 +2) 


Answer. ~In (x* +1) - ~In (x? +2) +0. 


dx 
x344x° 


S 
Answer, + Inx — + In (x2 +4) +e. 
4 8 
5 
S Qn x)? dx. 
x 
Answer. ~(In x)P +e. 
f xe dx. 
Answer. oF +. 


7T o z as ° 
Jo x sin nx dx, where n is a positive integer. 


7 7 
Answer. ——cosnz = —(—1)"t!. 
n n 


12 


15. 


16. > 


L7. 


JS e* sin 3x dx. 


200. 3 
Answer, e2* (= sin 3x — a cos 3x) +. 
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Hint. Look for the antiderivative in the form Ae2* sin 3x + Be2* cos 3x, and 
determine the constants A and B by differentiation. 


dx 


x(n xy , 


1 
Answer. —. 
In2 


fee dx. 


Answer, —x? 


e-* — 3x2e-* — 6xe~* — 6e-* +. 


II. Find the general solution of the linear problems. 


1. 


. xy’ +2y=e™%., 


y' —ysinx = sinx. 


Answer. y = —1+ ce ©°S*, 


yt ~y = COS X. 


c . cosSx 
Answer. y= — +sinx + —. 
x x 


x 


c x+le* 
Answer. y = > — Ss , 
x 


x2 
. x4y! + 3x3y = x7e*, 
_ ¢ (x—1)e* 
Answer. y = = + ae 
dy = o) 
bee 2x(x* + y). 


2 
Answer. y = ce* —x*—1. 


. xy’ —2y = xel*, 


Answer. y = cx? — x?el/*, 


. y +2y =sin 3x. 


7 oo 3 
Answer. y = ce~?* + =; Sin 3x — = cos 3x. 
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8. x(yy’-1l=y’. 


Hint. Set v = y*. Then v’ = 2yy’, and one obtains a linear equation for 
v = U(X). 
Answer. y? = —2x + cx’. 


III. Find the solution of the initial value problem, and state the maximum interval on 
which this solution is valid. 


1. y' —2y =e*, y(0) = 2. 
Answer. y = 3e?* — e*; (—0o, 00). 
2. y+ *y = cosx, y(—) =1. 
x 2 


cos x+x sin x 


Answer. y = es (0, 00). 
3. xy’ +2y= =, (5) =—-1. 
2 
Answer. y = ee (0, oo). 


4. xy’ +(24+x)y =1, y(-2) =0. 


1 1 
Answer. y = : + = (—oo, 0). 


; 1 
5. x" — y) = e*, (1) = =. 
Answer. y = e* In|x| + e*; (—oo, 0). 
6. (1422 +y=5,yQ)=1. 
St-2 7 
Answer. y = Par 2, 00). 


7. ty’ —2y = t* cost, y(z/2) = 0. 


Answer. y = t? sint + t? cost — a0; (—oo, co). The solution is valid for all t. 


8. tine +r=5te',r(2)=0. 


5e! —5e2 
Answer. r = ae ; (1, 00). 
n 
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10. 


11.* 


12.* 


13.* 


14.* 
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. xy +2y=y' t+ a } = 0. 


(x-1)? 


Injx-1|-In3 _ In(l—x)-In3 | 


Answer. y = (ap Gee ;(—oo, 1). 


dy 1 = 
dx ya YP) ey 


dx 


Hint. Consider om and obtain a linear equation for x(y). 
y 


Answer. x = —2 + 4e” — 2y—y’. 
Find a solution (y = y(t)) of y’ + y = sin 2t, which is a periodic function. 


Hint. Look for a solution in the form y(t) = A sin 2t + Bcos 2t, substitute this 
expression into the equation, and determine the constants A and B. 


; 2 
Answer. y = - sin 2t — 5 COS 2t. 
Show that the equation y’ + y = sin 2t has no other periodic solutions. 
Hint. Consider the equation that the difference of any two solutions satisfies. 


For the equation 

y' + a(x)y = f(x) 
assume that a(x) > dg > 0, where ap is a constant, and f(x) > O0asx > o. 
Show that any solution tends to zero as x > oo. 


Hint. Write the integrating factor as u(x) = elo ate) dt > e%*, so that u(x) > 
co as X — oo. Then express 
_ fo HOFOdt +c 
u(x) 


and use |’H6pital’s rule. 


Assume that in the equation (for y = y(t)) 


y' tay = f(t) 
the continuous function f(t) satisfies | f(«)| < M for all —oo < t < oo, where M 
and a are positive constants. Show that there is only one solution, call it yo(t), 
which is bounded for all —oo < t < oo. Show that lim;_,,, yo(t) = 0, provided 
that lim,_,,, f(t) = 0, and lim;_,_,, yo(t) = 0, provided that lim;_,_., f(t) 
= 0. Show also that yo(t) is a periodic function, provided that f(t) is a pe- 
riodic function. 


Hint. Using the integrating factor e“, express 


t 
et y(t) = iF e% f(s)ds +e. 
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Select c = 0 and a = —oo. Then y(t) = e tee eS f(s) ds, and |yo(t)| < 
eu fee e*|f(s)|ds < _ In case lim;,_., f(t) = 0, a similar argument 
shows that |yo(t)|_ < >; for —t large enough. In case lim,.,,, f(t) = 0, use 


lHO6pital’s rule. 


IV. Solve by separating the variables. 


T dy _ 2 
“dx x(y3+1)" 


Answer. a +y—21n|x|=c. 
2. e dx —ydy = 0, y(0) = -1. 


Answer. y = —\V 2e* — 1. 


3. (xy? + y*) dx — yx dy = 0. 


x2 
Answer. y=e2 


4, y! = x*4/4— y?. 


3 
Answer. y = 2sin(~ + c), and y = +2. 


x2 
TRIAS 2 c|x|e2 (writing e° = c). 


5. y(t) = ty7(1 + t?)-12, yo) = 2. 


Answer. y = 


2 
~ 2241-3" 
6. (y—xy+x—1)dx + x7 dy =0, y1) =0. 


ne 
e-exx 


Answer. y = 
7. x2y?y' =y—1. 
y 1 
Answer. > tytinly-l = —~+¢,and y = 1. 


8 y= ey, y(2) = 1. 


x 12 
Answer. y= e2 & 4, 


9. y = xy? + xy, (0) = 2. 


x2 
2e 2 

Answer. y = an 
3-2e 2 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 
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y' — 2xy” = 8x, y(0) = —2. 


Hint. There are infinitely many choices for c, but they all lead to the same 
solution. 


_ 2. 
Answer. y = 2tan (2x r : 
, 2 1 
VOSIHY = 5: 
Hint. Write the right-hand side as —=(2y — 1). 


1 


1 1 

Answer. y=-+ ,andy=-. 
y 2 t+c y 2 

dy _ yoy 

dx x - 


Answer. =| = e|x|, and also y = Oand y = 1. 
y 


dy _ y’-y = 
dx x we 


Answer. y = =. 

y =(+y), x0) =1. 

Hint. Set x + y = z, where z = z(x) is anew unknown function. 
Answer. y = —x + tan(x + me 


Show that one can reduce 


y' = f(ax + by) 
to a separable equation. Here a and b are constants, and f = f(z) is an arbi- 
trary function. 


Hint. Set ax + by = z, where z = z(x) is a new unknown function. 


A particle is moving on a polar curve r = f(@). Find the function f(@) so that 
the speed of the particle is 1, for all 6. 


Hint. x = f(@)cos 0, y = f(@)sin 9, and then 
2 2 
speed? = (S) +() = f'7(6) + f2(0) =1, 
or f’ = +V1- f?2. 


Answer. f(@) = +1, or f(@) = +sin(@ +c). (r = sin(@ +c) is a circle of radius 
- with center on the ray 6 = 7 — cand passing through the origin.) 
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17.* Find the differentiable function f(x) satisfying the following functional equa- 
tion (for all x and y): 


f(x) + fY) 
1— fx)fo)’ 


Hint. By setting x = y = 0, conclude that f(0) = 0. Then 


fa) = tm F+W OD 


f(x+y)= 


c(1 + f2(x)), 


> 


where c = f'(0). 


Answer. f(x) = tancx. 


1.4 Some Special Equations 


Differential equations that are not linear are called nonlinear. In this section we en- 
counter several classes of nonlinear equations that can be reduced to linear ones. 


1.4.1 Homogeneous Equations. Let f(t) be a given function. Setting here t = 
< we obtain a function f( =) which is a function of two variables x and y, but it depends 


on them in a special way. One calls functions of the form f (2) homogeneous. For 
x 
4x, : ides awe nats 
example, ye" isa homogeneous function, because we can put it into the form (dividing 
x-y 


both the numerator and the denominator by x) 


y 
y-4x 4 
x-y 1-2’ 
x 
so that here f(t) = —. 
Our goal is to solve homogeneous equations 
dy y 
i= f(). (1.4.1) 


Set v = ~. Since y isa function of x, the same is true of v = v(x). Solving for y, y = xv, 
x 
we express by the product rule 


dy =) + ee 
dx dx 
Switching to v in ({1.4.1)) gives 
du 
v+ = fv). (1.4.2) 


This is a separable equation! Indeed, after taking v to the right, we can separate the 


variables 
dv _ { dx 
fw)-v- J x? 


After solving this equation for u(x), we can express the original unknown y = xvu(x). 
In practice, one should try to remember the formula (1.4.2). 
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Example 1.4.1. Solve 


dy x*+3y? 
dx = 2xy 
y(1) = -2. 


To see that this equation is homogeneous, we rewrite it as (dividing both the numerator 
and the denominator by x”) 


dy _ 1a(2) 
dx 2 ° 


x 


A d d : 
Set v = =. or y = xv. Using that ee xo. obtain 
x dx dx 


ped = 143? 
dx 2w ~- 
Simplify: 
yal _ 1 +30" _1+v? 
dx —-2u “2 Qy<* 


Separating the variables gives 


ae dv= ae 
1l+v2 x? 


We now obtain the solution by performing the following steps (observe that Inc is an- 
other way to write an arbitrary constant): 


In(1 + v7) = Inx +Inc = Inex, 
1+v* =cx, 
v=+vVex—1, 
V(X) = XV = +xVex — 1. 
From the initial condition 
y) = +¥e-1 = -2. 


It follows that we need to select “minus” and c = 5. 


Answer. y(x) = —xV5x-1. 


There is an alternative (equivalent) definition: a function f(x, y) is called homoge- 
neous if 


f(tx, ty) = f(x, y), for all constants t. 


If this condition holds, then setting t = =, we see that 
= _ y 
SQ y) = f(t, ty) = fA >); 


so that f(x, y) is a function of ~, and the old definition applies. It is easy to check that 
x 


f(x,y) = 


x243 


2 
: » from the Example satisfies the new definition. 
xy 
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Example 1.4.2. Solve 
dy _ 


with x > 0,y > 0. 


y 

dx x+4.4/xy 

It is more straightforward to use the new definition to verify that the function f(x, y) = 
a homogeneous. For all t > 0, we have 


x+4/xy 


(ty) bd 
f (tx, ty) = —————. = —~— = f(x,y). 
(tx) + ¥(tx)(ty) *+yxXy 
Letting y/x = v, or y = xv, we rewrite this equation as 


’ Xv D 
v+xu' = ——— = 


x+xxv 1+v 
We proceed to separate the variables: 


1+ vv d 
[ZFo--/F 
v3/2 x 
—2v7¥2 4+ Inv =—-Inx +c. 


The integral on the left was evaluated by performing division and splitting it into two 
pieces. Finally, we replace v by y/x and simplify: 


-2,/%+m¥ =-Inx +e 
y x 
x 
—2,/—+lny=c. 
V3 - 


We obtained an implicit representation of a family of solutions. One can solve for x, 
x= “y (c- Iny)’. 

When separating the variables, we had to assume that v ¥ 0 (in order to divide by 
v2), In case v = 0, we obtain another solution: y = 0. 


1.4.2 The Logistic Population Model. Let y(t) denote the number of rabbits 
on a tropical island at time t. The simplest model of population growth is 


y' = ay, 

y(0) = yo. 
Here a > 0 is agiven constant, called the growth rate. This model assumes that initially 
the number of rabbits was equal to some number yp > 0, while the rate of change of 
population, given by y’(t), is proportional to the number of rabbits. The population 


of rabbits grows, which results in a faster and faster rate of growth. One expects an 
explosive growth. Indeed, solving the equation, we get 


y(t) = ce. 
From the initial condition, y(0) = c = yo, which gives us y(t) = yge®, an exponential 
growth. This is the notorious Malthusian model of population growth. Is it realistic? 
Yes, sometimes, for a limited time. If the initial number of rabbits yy is small, then for 
a while their number may grow exponentially. 
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A more realistic model, which can be used for a long time, is the logistic model: 
y’ =ay— by’, 
y(0) = yo. 


Here a, b, and yp are given positive constants, and y = y(t). Writing this equation in 
the form 


(1.4.3) 


, a 
y= by(5-). 
we see that when 0 < y < we have y’(t) > 0 and y(t) is increasing, while in the case 
y> ; we have y’(t) < 0 and y(t) is decreasing. 

If yy is small, then for small t, y(t) is small, so that the by” term is negligible, and 
we have exponential growth. As y(t) increases, the by” term is not negligible anymore, 
and we can expect the rate of growth of y(t) to get smaller and smaller and y(t) to tend 
to a finite limit 7 (Writing the equation as y’ = (a — by)y, we can regard the a — by 
term as the rate of growth.) In case the initial number yp is large (when yg > a/b), 
the quadratic on the right in is negative, so that y’(t) < 0, and the population 
decreases. If yp = a/b, then y’(0) = 0, and we expect that y(t) = a/b for all t. We now 
solve the equation to confirm our guesses. 

This equation can be solved by separating the variables. Instead, we use another 
technique that will be useful in the next section. Divide both sides of the equation by 
y*: 

yy! =ay*—b. 


Introduce a new unknown function u(t) = y71(t) = aa By the generalized power 
rule, v’) = —y~7y’, so that we can rewrite the last equation as 

—v’ =au—b, 
or 

v’ +av=b. 


This is a linear equation for u(t)! To solve it, we follow the familiar steps, and then we 
return to the original unknown function y(t): 


u(t) = ef adt = ett 


eto=b f edt = etic 
b 
v= —+ce%, 
a 
1 1 
y(t) = a ee 
— +ce-at 
a 


To find the constant c, we use the initial condition 


1 
yO=5 = Yo» 
-+C 
a 

1 b 
c=—--. 
Yo a 
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Figure 1.2. The solution of y’ = 5y — 2y”, y(0) = 
0.2. 


We conclude: 


1 
y(t) = ——_———_-. 
b + (— — °) enat 
a Yo a 


Observe that lim,_,,, y(t) = a/b, no matter what initial value yy we take. The number 
a/b is called the carrying capacity. It tells us the number of rabbits, in the long run, 
that our island will support. A typical solution curve, called the logistic curve is given 


in Figure [I.2, 
1.4.3 Bernoulli's Equations. Let us solve the equation 


y(t) = pOy®) + gy" (t). 


Here p(t) and g(t) are given functions, n is a given constant. The logistic model above 
is just a particular example of Bernoulli’s equation. 
Proceeding similarly to the logistic equation, we divide this equation by y”: 


y"y' = p(y" + g(0). 
Introduce a new unknown function v(t) = y!~"(t). Compute v’ = (1 — n)y~"y’, so 
that y""y' = —v,, and rewrite the equation as 


v’ = (1—n)p(t)u + (1 — n)g(t). 
This is a linear equation for v(t)! After solving for v(t), we calculate the solution y(t) = 
1 
vi-n(t). 
Example 1.4.3. Solve 
y =yt+—. 
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Writing this equation in the form y’ = y+ty~/?, we see that this is Bernoulli’s equation, 
with n = —1/2, so that we need to divide through by y~”?. But that is the same as 
multiplying through by y!/?, which we do, obtaining 

yy! =_ yl? + t. 
We now let v(t) = y*”, v(t) = =yl2y!, obtaining a linear equation for v, which is 
solved as usual: 


3 3 
-p’ = t, a t, 
U vU+ Uv 50 >) 
_f3 3 d 3 3 
M(t) =e Lat exe e Sle u| = te 2°, 


3 


_3 3-3 a 2.23 
e fox fe 2' dt = —te 2! — Se 2 +0, 


35 


v=-t 2 eas 
= 5 , 


3. \2/3 
Returning to the original variable y, gives the answer: y = (- ares ce") : 


1.4.4* Riccati’s Equations. Let us try to solve the equation 


y(t) + a(t)y(t) + b(t)y?(t) = c(t). 


Here a(t), b(t), and c(t) are given functions. In case c(t) = 0, this is Bernoulli’s equa- 
tion, which we can solve. For general c(t), one needs some luck to solve this equation. 
Namely, one needs to guess some solution p(t), which we refer to as a particular solu- 
tion. Then a substitution y(t) = p(t) + z(t) produces Bernoulli’s equation for z(t), 


z' +(a+ 2bp)z+ bz” =0, 


which can be solved. 
There is no general way to find a particular solution, which means that one cannot 
always solve Riccati’s equation. Occasionally one can get lucky. 


Example 1.4.4. Solve 
y +y? = 0? —2t. 


We see a quadratic polynomial on the right, which suggests to look for a particular 
solution in the form y = at + b. Substitution into the equation produces a quadratic 
polynomial on the left too. Equating the coefficients in ¢?, t, and constant terms gives 
three equations to find a and b. In general, three equations with two unknowns will 
have no solution, but this is a lucky case, with the solution a = —1, b = 1, so that 
p(t) = -t + 1 is a particular solution. Substituting y(t) = —t + 1 + v(t) into the 
equation and simplifying, we get 


v’ +201 —t)v = —v?. 
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This is Bernoulli’s equation. Divide through by v’, and then set z = of Z=- -, to get 
Uv Uv 

a linear equation: 


v~2v' + 2(1 — t)v-! = -1, z’—2(1-—nHz=1, 


— p—-S20-t)dt — pt?—-2t a t?-2t,] _ pt?-2t 
fae =e - a [e z| =e ; 


2. 2 
ge = fe =P Ot 


The last integral cannot be evaluated through elementary functions (Mathematica can 
evaluate it through a special function, called Erfi). So we leave this integral unevalu- 
ated. One gets z from the last formula, after which one expresses v, and finally y. The 
ef?-2t 
f et?—2t dt 
c is now “inside” of the integral. Replacing f ett dt by is e -25 ds will give a for- 
mula for y(t) that can be used for computations and graphing.) Another solution is 
y = —t + 1 (corresponding to v = 0). 


result is a family of solutions: y(t) = —t +1+ . (The usual arbitrary constant 


Example 1.4.5. Solve 


, 6 
y' +2y? = 5. (1.4.4) 
We look for a particular solution in the form y(t) = a/t and calculate a = 2, so that 
p(t) = 2/t is a particular solution (a = —3/2 is also a possibility). The substitution 


y(t) = 2/t + v(t) produces the Bernoulli’s equation 


vi + Sv+20? =0. 


7 


Solving it gives u(t) = = and v = 0. The solutions of (1.4.4) are y(t) = ; + 


ct8 ct8—2t 
and also y = -. 
Let us outline an alternative approach to the last problem. Setting y = 1/z in 


(1.4.4), then clearing the denominators, gives 


Zz’ 1 6 
= tea = Bi 
Zz Zz t2 
6z2 
’ -_ 
—Z+2= a 


This is a homogeneous equation, which we can solve. 


There are some important ideas that we learned in this subsection. Knowledge of 
one particular solution may help to “crack open” the equation and get other solutions. 
Also, the form of this particular solution depends on the equation. 


1.4.5* Parametric Integration. Let us solve the initial value problem (here y = 


y(x)) 
yayl-y”, (1.4.5) 
y(0) = 1. 


This equation is not solved for the derivative y’(x). Solving for y’(x) and then separat- 
ing the variables, one can indeed find the solution. Instead, let us assume that 


y'(x) = sint, 
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where ¢ is a parameter (upon which both x and y will depend). From the equation 


((1.4.5)), 
y=V 1 —sin’ t = Vcos? t = cost, 


assuming that cost > 0. Recall the differentials: dy = y'(x) dx, or 


ea oe 
y' (x) sin t 
so that - = —1, which gives 
x=-tt+ec. 


We obtained a family of solutions in parametric form (valid if cost > 0) 


x=-t+¢, 
y=cost. 
Solving for t, t = —x + c, gives y = cos(—x + c). From the initial condition, calculate 


that c = 0, giving us the solution y = cosx. This solution is valid on infinitely many 
disjoint intervals where cos x > 0 (because we see from the equation ({1.4.5) that y > 0). 
This problem admits another solution: y = 1. 
For the equation 
y? +y’ — x 

we do not have an option of solving for y'(x). Parametric integration appears to be 
the only way to solve it. We let y’(x) = t, so that from the equation, x = O+t, and 
dx = = dt = (5t* +. 1)dt. Then 


dy = y'(x)dx = t(5t* + 1) dt, 


so that 2 = t(5t* +1), which gives y = 46 + =f +c. We obtained a family of solutions 
in parametric form: 
x=P+t, 
5 1 
= 51° + -t +0. 
p= 


If an initial condition is given, one can determine the value of c and then plot the 
solution. 


1.4.6 Some Applications. Differential equations arise naturally in geometric and 
physical problems. 


Example 1.4.6. Find all positive decreasing functions y = f(x), with the following 
property: the area of the triangle formed by the vertical line going down from the curve, 
the x-axis, and the tangent line to this curve is constant, equal to a > 0. 

Let (Xo, f(Xo)) be an arbitrary point on the graph of y = f(x). Draw the triangle 
in question, formed by the vertical line x = xg, the x-axis, and the tangent line to 
this curve. The tangent line intersects the x-axis at some point x,, lying to the right 
of x9, because f(x) is decreasing. The slope of the tangent line is f’(x9), so that the 
point-slope equation of the tangent line is 


y = fo) + f'(%o)(X — Xo). 
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A 


(xo, f(Xo)) 


Xo xX} 


The triangle formed by the tangent line, the line x = 
Xo, and the x-axis. 


At x;, we have y = 0, so that 


0 = f(Xo) + f’(%o)(%1 — Xo). 


Solve this for x,, x; = X9 — Teo It follows that the horizontal side of our triangle is 
0 
a 7 oat while the vertical side is f(x9). The area of this right triangle is then 
0 
_1f?(o) a5 
2 f'(Xo) 


(Observe that f’(x9) < 0, so that the area is positive.) The point x9 was arbitrary, so 
that we replace it by x, and then we replace f(x) by y and f’(x) by y’: 


1y? ; 
Sa er 
2y' y2 2a 
We solve this differential equation by taking the antiderivatives of both sides: 
ta sxte 
y 2a : 
2a 2 


Answer. y(x) = 


See . . a 
oer This is a family of hyperbolas. One of them is y = = 
Example 1.4.7. A tank holding 10L (liters) originally is completely filled with water. 
A salt-water mixture is pumped into the tank at a rate of 2L per minute. This mixture 
contains 0.3 kg of salt per liter. The excess fluid is flowing out of the tank at the same 
rate (2L per minute). How much salt does the tank contain after 4 minutes? 

Let t be the time (in minutes) since the mixture started flowing, and let y(t) denote 
the amount of salt in the tank at time t. The derivative, y’(t), approximates the rate of 
change of salt per minute, and it is equal to the difference between the rate at which 
salt flows in and the rate it flows out. The salt is pumped in at a rate of 0.6 kg per 


minute. The density of salt at time t is “0 (so that each liter of the solution in the tank 
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/\ 
\ \ 
\ 


Salt-water mixture pumped into a full tank. 


contains ~O kg of salt). Then, the salt flows out at the rate 20 = 0.2y(t) kg/min. The 


difference of these two rates gives y’(t), so that 
y' = 0.6 — 0.2y. 


This is a linear differential equation. Initially, there was no salt in the tank, so that 
y(0) = 0 is our initial condition. Solving this equation together with the initial condi- 
tion, we have y(t) = 3 — 3e~°-". After 4 minutes, we have y(4) = 3 — 3e-°8 & 1.65 kg 
of salt in the tank. 


Now suppose a patient has alcohol poisoning and doctors are pumping in water 
to flush his stomach out. One can compute similarly the weight of poison left in the 
stomach at time t. (An example is included in the Problems.) 


1.5 Exact Equations 


This section covers exact equations. While this class of equations is rather special, it 
often occurs in applications. 

Let us begin by recalling partial derivatives. If a function f(x) = x*+a depends on 
a parameter a, then f’(x) = 2x. If g(x) = x*+y%, with a parameter y, we have “a = 2X: 
Another way to denote this derivative is g, = 2x. We can also regard g as a function 
of two variables, g = g(x, y) = x + y*. Then the partial derivative with respect to x is 
computed by regarding y to be a parameter, g, = 2x. Alternative notation: a = 2x. 
Similarly, a partial derivative with respect to y is g, = =e = 3y?. The derivative gy 


gives us the rate of change in y, when x is kept fixed. 
The equation (here y = y(x)) 


y? + 2xyy’ =0 
can be easily solved if we rewrite it in the equivalent form 
d 
oF (xy?) = 0. 
Then xy" = c, and the solution is 
c 
y(x) = +——. 
Vx 


We wish to play the same game for general equations of the form 


M(x, y) + N(x, y)y’(x) = 0. (1.5.1) 
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Here the functions M(x, y) and N(x, y) are given. In the above example, M = y? and 
N = 2xy. 


Definition. The equation (1.5.1) is called exact if there is a function 7)(x, y), with con- 
tinuous derivatives up to second order, so that we can rewrite (1.5.1) in the form 


£ yey) =0. (1.5.2) 


The solution of the exact equation is (c is an arbitrary constant) 


p(x, y) =c. (1.5.3) 
There are two natural questions: what conditions on M(x, y) and N(x, y) will force 
the equation ({1.5.1}) to be exact, and if the equation ({1.5.1]) is exact, how does one find 
px, y)? 


Theorem 1.5.1. Assume that the functions M(x, y), N(x, y), M yx, y), and N,.(x, y) are 
continuous in some disc D : (x—X9)* +(y—Yyo)* < r’, around some point (Xo, yo). Then 
the equation (1.5.1) is exact in D if and only if the following partial derivatives are equal: 


My(x, y) = Nx(x, y), for all points (x, y) in D. (1.5.4) 
This theorem makes two claims: if the equation is exact, then the partials are equal, 


and conversely, if the partials are equal, then the equation is exact. 


Proof. (1) Assume that the equation (1.5.1) is exact, so that it can be written in the 
form (1.5.2). Performing the differentiation in (5.2), using the chain rule, gives 


y + pyy’ =0. 
But this equation is the same as (1.5.1), so that 
oy, = M, 
Py =N 
Taking the second partials, 
dry = My, 
Pyx = Ny. 


We know from calculus that ~,) = py; therefore, M, = N,. 


(2) Assume that M, = N,. We will show that the equation ({1.5.1)) is then exact by 
producing #(x, y). We have just seen that (x, y) must satisfy 


~, = M(x,y), (1.5.5) 
py = Ny). ie 
Take the antiderivative in x of the first equation 
x 
px, y) = il M(t, y) dt + h(y), (1.5.6) 
xo 


where h(y) is an arbitrary function of y and x, is an arbitrary number. To determine 
h(y), substitute the last formula into the second line of (1.5.5): 


dy(ny) = i) M,(t,y) dt + h'(y) = NOay), 
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or 
h'(y) = N@ay) - i M,(t,y)dt = p(x.y). (1.5.7) 


Observe that we denoted by p(x, y) the right side of the last equation. It turns out 
that p(x, y) does not really depend on x! Indeed, taking the partial derivative in x, 

a) 

5x POY) = N,(x, y) x M,(x, y) =0, 
because it was given to us that My(x, y) = N,(x, y), so that p(x, y) is a function of 
y only, or p(y). The equation takes the form 

h'(y) = pQ). 

We determine h(y) by integration and use it in to get P(x, y). 


Recall that the equation in differentials 
M(x, y) dx + N(x, y)dy =0 
is an alternative form of (f.5.1), so that it is exact if and only if My = Ny, for all x and 
y. 
Example 1.5.1. Consider 
e* siny + y? — (3x — e* cos y) o =0. 

Here M(x, y) = e* siny + y*, N(x, y) = —3x + e* cos y. Compute 

My = e* cosy + 3y?, 

Ny, = e* cosy — 3. 


The partials are not the same, this equation is not exact, and our theory does not apply. 


Example 1.5.2. Solve (for x > 0) 
(2 + 6x) dx + (Inx — 2) dy=0. 
Here M(x, y) = ° + 6x and N(x, y) = Inx — 2. Compute 


1 
M,===N,, 
(-. >= 
and so the equation is exact. To find (x, y), we observe that the equations take 
the form 


Pe = > + 6x, 
yy =Inx-2. 


Take the antiderivative in x of the first equation, 
~(x, y) = ylnx + 3x* + h(y), 
where h(y) is an arbitrary function of y. Substitute this p(x, y) into the second equation, 


dy =Inx +h'(y) =Inx—-2, 
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which gives 
h'(y) = -2. 
Integrating, h(y) = —2y, and so p(x, y) = yln x + 3x? — 2y, giving us the solution 
ylnx + 3x* -2y=c. 
c—3x? 


Inx-2° 
chose the integration constant to be zero, because at the next step we set (x, y) equal 


to c, an arbitrary constant. 


We can solve this relation for y, y(x) = 


Observe that when solving for h(y), we 


Example 1.5.3. Find the constant b, for which the equation 
(2x3e*Y + x4 ye + x) dx + bx°eY dy = 0 


is exact, and then solve the equation with that b. 
Here M(x, y) = 2x3e*” + x4ye*Y + x, and N(x, y) = bx5e?*”. Setting equal the 
partials M, and N,, we have 


5x4 62x + 2x°ye2*Y = 5Sbx4e?*Y + 2bx>ye2*Y, 
One needs b = 1 for this equation to be exact. When b = 1, the equation becomes 
(2x362*Y + x4yeXY + x) dx + xe dy =0, 


and we already know that it is exact. We look for p(x, y) by using (1.5.5), as in Exam- 
ple 

Dy, = 2x3e?*Y + x4 ye + x, 

pare. 


It is easier to begin this time with the second equation. Taking the antiderivative in y, 
in the second equation, 


YOY) = 5xte™? + AC), 


where h(x) is an arbitrary function of x. Substituting (x, y) into the first equation 
gives 


Dy = 2x3 e2*) + x4 ye2*Y + h'(x) = 2x36?) + xtyer*Y + x. 


This tells us that h’(x) = x, h(x) = =x?, and then (x, y) = =xteoy + =x, 


Answer, =x4e*) + +x? =c,ory = —In (=). 
2 2 2x x4 
Exact equations are connected with conservative vector fields. Recall that a vec- 
tor field F(x, y) = (M(x, y), N(x, y)) is called conservative if there is a function (x, y), 
called the potential, such that F(x, y) = V(x, y). Recalling that the gradient Vp(x, y) = 
(px, Py), we have p, = M and wp, = N, the same relations that we had for exact equa- 
tions. 
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1.6 Existence and Uniqueness of Solution 


We consider a general initial value problem 


y' = f(y) 
y(Xo) = Yo; 
with a given function f(x, y) and given numbers x, and yp. Let us ask two basic ques- 
tions: is there a solution to this problem, and if there is, is the solution unique? 


Theorem 1.6.1. Assume that the functions f(x,y) and f,(x, y) are continuous in some 
neighborhood of the initial point (x9, yo). Then there exists a solution, and there is only 
one solution. The solution y = y(x) is defined on some interval (x1, Xz) that includes Xo. 


One sees that the conditions of this theorem are not too restrictive, so that the 
theorem tends to apply, providing us with the existence and uniqueness of the solution. 
But not always! 


Example 1.6.1. Solve 


y=yy, 
y(0) = 0. 
The function f(x,y) = Jy is continuous (for y > 0), but its partial derivative in y, 
fy y) = ar is not even defined at the initial point (0, 0). The theorem does not apply. 


2 
One checks that the function y = ~ solves our initial value problem (for x > 0). But 


here is another solution: y(x) = 0. (Having two different solutions to the same initial 
value problem is like having two prima donnas in the same theater.) 

Observe that the theorem guarantees existence of solution only on some interval 
(it is not “happily ever after”). 


Example 1.6.2. Solve for y = y(t) 
yay’, 
y(0) = 1. 
Here f(t, y) = y* and fy(t, y) = 2y are continuous functions. The theorem applies. By 


separation of variables, we determine the solution y(t) = a As time t approaches 


1, this solution disappears, by going to infinity. This phenomenon is sometimes called 
the blow-up in finite time. 


1.7 Numerical Solution by Euler’s Method 


We have learned a number of techniques for solving differential equations; however, 
the sad truth is that most equations cannot be solved (by a formula). Even a simple 
looking equation like 
y=xt+y (1.7.1) 
is totally out of reach. Fortunately, if you need a specific solution, say the one satisfying 
the initial condition 
y(0) = 1, (1.7.2) 
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it can be easily approximated using the method developed in this section (by Theorem 
such a solution exists, and it is unique because f(x, y) = x+y? and fy y) = 3y? 
are continuous functions). 

In general, we shall deal with the problem 


y’ = f(x, y), 
Y(Xo) = Yo- 


Here the function f(x, y) is given (in the example above we had f(x, y) = x + y*), and 
the initial condition prescribes that the solution is equal to a given number yp at a given 
point xg. Fixa step size h, and let x, = x9 +h, x2 =X9+2h,...,X, =Xg+nh. Wewill 
approximate y(x,,), the value of the solution at x,,. We call this approximation y,. To 
go from the point (x, y,,) to the point (X41, ¥y41) on the graph of the solution y(x), 
we use the tangent line approximation: 


Ynti © Yn + Y Xn) Xn41 = Xn) = Vn t+ y (x,)h = Vn t+ fn» Yn)h. 


(We expressed y’(x,,) = f(xy, y,) from the differential equation. Because of the ap- 
proximation errors, the point (x, y,) is not exactly lying on the solution curve y = y(x), 
but we pretend that it does.) The resulting formula is easy to implement; it is just one 
computational loop, starting with the initial point (9, yo). 

One continues the computations until the points x, go as far as needed. Decreas- 
ing the step size h will improve the accuracy. Smaller h’s will require more steps, but 
with the power of modern computers, that is not a problem, particularly for simple 
examples, like the problem (1.7.1), (1.7.2), which is discussed next. In that example 
Xq = 0, Yo = 1. If we choose h = 0.05, then x, = 0.05, and 


yi = Yo + F(X, Yo)h = 1+ (0 + 1°)0.05 = 1.05. 
Continuing, we have x, = 0.1 and 
yy =, + F(X, yh = 1.05 + (0.05 + 1.057)0.05 & 1.11. 
Next, x3 = 0.15, and 
y3 = yo t+ f(X2, yh = 1114+ (0.1 + 1.113)0.05 = 1.18. 


These computations imply that y(0.05) = 1.05, y(0.1) = 1.11, and y(1.15) = 1.18. If 
you need to approximate the solution on the interval (0,0.4), you have to make five 
more steps. Of course, it is better to program a computer. A computer computation 
reveals that this solution tends to infinity (blows up) at x ~ 0.47. Figure [1.3] presents 
the solution curve, computed by Mathematica, as well as the three points we computed 
by Euler’s method. 

Euler’s method is using the tangent line approximation, or the first two terms of 
the Taylor series approximation. One can use more terms of the Taylor series and de- 
velop more sophisticated methods (which is done in books on numerical methods and 
implemented in software packages, like Mathematica). But here is a question: if it is so 
easy to compute numerical approximation of solutions, why bother learning analytical 
solutions? The reason is that we seek not just to solve a differential equation, but to 
understand it. What happens if the initial condition changes? The equation may in- 
clude some parameters. What happens if they change? What happens to solutions in 
the long term? 
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Figure 1.3. The numerical solution of y’ = x + y’, 
y(0) = 1. 


1.72.1 Problems. 
I. Determine if the equation is homogeneous, and if it is, solve it. 


dy _ y+2x 
dx 


1. , with x > 0. 


Answer. y = x(2Inx +c). 
2. (x+y) dx-—xdy=0. 
Answer. y = x (In |x| +). 


3 dy _ x?—xyt+y? 


dx x2 


Answer. y = x (1 = ), andy =x. 


In |x|+c 


dy _ y*+2x 
dx y : 


2 
5. y= 5+i y=. 


Answer. y = 5 
1-Inx 


2 
6. y= 5 + = ¥-1) =1. 


x 


Answer. y = “ae 
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7. 


10. 


11. 


12. 


13.* 


dy y*+2xy 
— = —— , y(1) =2. 
a rae”, 
2x? 
Answer. y = 5 
3-2x 


; xy! —y = xtan®. 


Answer, sin~ = cx. 
x 


, x 


. xy’ = —+H+y. 


x+y 


Answer. y= —x + xvV2In|x| +c. 


re x+y? 2s. 
JS Se 


Answer. y= —xy2Inx+4. 


‘an yrx 2 3/2 


= , withx > 0,y>0. 
y es) with x y 
Answer. a/% =Inx+ec. 

xy = y*(y— xy’). 


2 
1/y _ - 
Answer. |n|y| + ~ (2) =c,andy=0. 


A function f(x, y) is called quasi-homogeneous if for any constant a 


flax, aPy) = a" f(x, y), 


with some constant p. 


(i) Letting a = ~ andv = =, verify that 
x x! 


f(x,y) = xP! g(v), 


where g(v) is some function of one variable. 
(ii) Consider a quasi-homogeneous equation 


y’ S f(x,y), 


33 


where f(x, y) is a quasi-homogeneous function. Show that a change of 


variables v = = produces a separable equation. 
x 


(iii) Solve 
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2 
Hint. Denoting f(x,y) = x+ “57 we have f (ax, ay) = af(x, y), so that 
p = 2. Letting v = 2, ory= x2v, we get 
x 


xv’ =1—2v4+v*. 


Answer. y= (1- : ) 


In |x|+ce 
II. Solve the following Bernoulli’s equations. 
1. y'(t) = 3y-y’. 


3 
Answer. y = ———, andy =0. 
y 1+ce—3t y 


’ 1 
2. y' — y= y", y(2) = -2. 


2x 


—x2° 


Answer. y = ; 


3. xy’ +y + xy”? =0, y(1) =2. 


2 


Answer. y = ————. 
y x(1+21n x) 


4. y' +y = xy, y(0) = -1. 


V2 
Answer. y = -—————— 
y V2x+e2% +1 
5 dy _ y?+2x 
an a 


Answer. y = +V—1— 2x + ce2*, 


6. y +xVy = 3y. 
3 
Answer. y = +(* + . + ge) andy =0. 
Hint. When dividing the equation by Vy , one needs to check if y = Oisa 


solution, and indeed it is. 


7. y +y = xy’. 


Answer. y = ——, andy =0. 


F 1 
8. y' +xy=y*, y) = —-. 


1 


Answer. y = —-———————.. 
af -20%? Se e-? dt-+e?+) 
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9. 


10. 


11. 


12. 


13. 


Wl. 1. 


The equation 

dy _ y?+2x 

ae 2 aye © 
could not be solved in the preceding problem set because it is not homoge- 
neous. Can you solve it now? 


Answer. y = +vV ce2* — 2x —1. 


u 


x 2x 
= Ser" + y. 
y 5 y 


Answer. y = +e*V x2 +0. 


Solve the Gompertz population model (a and b are positive constants) 


dx 
a =x(a—blinx), x>1. 


Hint. Setting y = Inx, obtain y’ = a — by. 


-b 
Answer. x(t) = e@/ece 


Solve 
x(y’ —e”)+2=0. 


Hint. Divide the equation by e” and then set v = e~”, obtaining a linear equa- 
tion for v = v(x). 


Answer. y = —In(x + cx”). 


dy __y 
dx x+x2y" 


Hint. Consider =, and obtain Bernoulli’s equation for x(y). 
y 


2y 


Answer. X = : 
c—y2 


Use parametric integration to solve 


3 sd 
y +y' =x. 


3 
Answer. x= +t, y= Fi oe +c. 


. Use parametric integration to solve 


y=Ind+ wy 


Answer. x = 2tan7't +c, y = In(1 + ¢?). Another solution is y = 0. 
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. Use parametric integration to solve 


y'+sing’)=x, y(0)=0. 


Answer. X =t+sint,y= ~? + tsint + cost — 1. 


. Solve the logistic model (for 0 < y < 3) 


y(t) =3y-y’, y(0)=1 
as a separable equation. What is the carrying capacity? What is lim,_,,, y(t)? 


3 . 
Answer. y(t) = ae? lim;_.o. y(t) = 3. 


. A tank is completely filled with 100L of water-salt mixture, which initially 


contains 10 kg of salt. Water is flowing in at a rate of 5L per minute. The new 
mixture flows out at the same rate. How much salt remains in the tank after 
an hour? 


Answer. Approximately 0.5 kg. 


. A tank is completely filled with 100L of water-salt mixture, which initially 


contains 10 kg of salt. A water-salt mixture is flowing in at a rate of 3L per 
minute, and each liter of it contains 0.1 kg of salt. The new mixture flows out 
at the same rate. How much salt is contained in the tank after t minutes? 


Answer. 10 kg. 


. Water is being pumped into patient’s stomach at a rate of 0.5L per minute to 


flush out 300 grams of alcohol poisoning. The excess fluid is flowing out at 
the same rate. The stomach holds 3L. The patient can be discharged when the 
amount of poison drops to 50 grams. How long should this procedure last? 


Answer. t = 61n6 = 10.75 minutes. 


. Temperature in a room is maintained at 70°. If an object at 100° is placed in 


this room, it cools down to 80° in 5 minutes. A bowl of soup at 190° is placed 
in this room. The soup is ready to eat at 130°. How many minutes should one 
wait? 


Hint. If y(t) is the temperature after ¢ minutes, it is natural to assume that the 
speed of cooling is proportional to the difference of temperatures, so that 


y’ = —k(y — 70) 
for some constant k > 0. We are given that y(5) = 80, provided that y(0) = 
In3 


100. This allows us to calculate k = se Then assuming that y(0) = 190, one 
calculates t such that y(t) = 130. 


In2 F 
Answer. t = 5 = 3.15 minutes. 
n 
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9. 


10. 


11. 


12. 


13. 


14. 


* 


15. 


Find all curves y = f(x) with the following property: if you draw a tangent 
line at any point (x9, f(X9)) on this curve and continue the tangent line until 
it intersects the x-axis, then the point of intersection is x9/2. 


Answer. y = cx? (a family of parabolas). 


Find all positive decreasing functions y = f(x) with the following property: 
in the triangle formed by the vertical line going down from the curve, the x- 
axis, and the tangent line to this curve, the sum of two sides adjacent to the 
right angle is a constant, equal to b > 0. 


Answer. y—biny=x+c. 


Find all positive decreasing functions y = f(x) with the following property: 
for the tangent line at (x9, f(x)), the length of the segment between the point 
(xo, f(Xo)) and the y-axis is equal to 1, for all 0 < xg <1. 


Answer. y= —V¥1—x?-—Inx+4+lIn [1 +yv1- x2 +c. This historic curve (first 
studied by Huygens in 1692) is called the tractrix. 


Find all curves y = f(x) such that the point of intersection of the tangent 
line at (Xo, f(Xo)) with the x-axis is equidistant from the origin and the point 


(Xo; f(Xo)), at any Xo. 


Answer. x? + y* = cy, a family of circles. (Hint. The differential equation 
, 2x 


= ire 
=a homogeneous.) 


Solve Riccati’s equation 
y’ of: 2e*y -y =e+4 ex. 


1 
Answer. y = e*, and y = e* — —. 
y : y x+c 


Solve Riccati’s equation 
y! + (2e* + 2) y —e*y* = e* +2, 


Answer. y=1,andy =1+—— 


eX+ce2x 
(From the Putnam competition, 2009) Show that any solution of 
2-2 
x2(y? + 1) 


= 
satisfies lim,_,,, y(x) = 0. 


Hint. Using “partial fractions”, rewrite this equation as 
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Then y’(x) > -<, which precludes y(x) from going to —oo. So, either y(x) 
is bounded or it goes to +oo, as xX — oo (possibly along some sequence). If 
y(x) is bounded when x is large, then y’(x) exceeds a positive constant for all 
large x, and therefore y(x) tends to infinity, a contradiction (observe that 1/ x? 
becomes negligible for large x). Finally, if y(x) failed to tend to infinity as 
x — oo (while going to infinity over a subsequence), it would have infinitely 
many points of local minimum, at which y = x, a contradiction. 


Solve the integral equation 
x 
y(x) = i y(t) dt +x +1. 
1 


Hint. Differentiate the equation, and also evaluate y(1). 


Answer. y = 3e*-! — 1, 


IV. Determine if the equation is exact, and if it is, solve it. 


1. 


(2x + 3x*y) dx + (x3 — 3y*) dy =0. 


Answer. x7 + x3y-ye =. 


. (x +siny)dx + (xcosy — 2y)dy = 0. 


1 : 
Answer. 5x +xsiny—y?=c. 


a dy =0. 


 x24y4 x24y4 


Answer. x* + yt =c. 


. Find a simpler solution for the preceding problem. 


. (6xy — cos y) dx + (3x7 + xsiny + 1)dy =0. 


Answer. 3x?y—xcosy+y=c. 


. (2x — y)dx + (2y — x) dy = 0, y(1) = 2. 


Answer. x? + y? — xy =3. 


’ 2x (1+ Vx? —y) dx —V x2 -—ydy =0. 


3 
Answer. x” + : (x? -y)? =e. 
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8. 


10. 


11. 


(ye*” sin 2x + 2e*” cos 2x + 2x) dx + (xe*” sin 2x — 2) dy = 0, y(0) = —2. 


Answer. e*” sin 2x + x? — 2y =4. 


. Find the value of b for which the following equation is exact, and then solve 


the equation, using that value of b: 


(ye*Y + 2x) dx + bxe’’ dy =0. 
Answer. b=1,y = In(c — x7), 


Verify that the equation 
(2siny + 3x) dx+ xcosydy =0 
is not exact; however, if one multiplies it by x, the equation becomes exact, 


and it can be solved. 


2 


Answer. x*siny +x? =c. 


Verify that the equation 
(x — 3y) dx + (x+y) dy=0 


is not exact; however, it can be solved as a homogeneous equation. 


Answer. In|y — x| + =e 
x-y 


. Find three solutions of the initial value problem 


POH, Web 
Is it desirable in applications to have three solutions of the same initial value 
problem? What “went wrong”? (Why doesn’t the existence and uniqueness 


Theorem apply here?) 


3 
Answer. y(x) = 1, and y(x) =1+ (=x = =)? 


. Find all yg for which the following problem has a unique solution: 


x 
i= | 2)= . 
ae aS y(2) = Yo 
Hint. Apply the existence and uniqueness Theorem [1.6.1 


Answer. All yo except +2. 


. Show that the function _ solves the problem 


y =v, 
y(0) = 0, 


for all x. Can you find another solution? 
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Hint. Consider separately the cases when x > 0, x < 0,and x = 0. 


4. Show that the problem (here y = y(t)) 
y=y 
y(0) = 0 


has infinitely many solutions. 


—~q)y 
Hint. Consider y(t) that is equal to zero for t < aand to a for t > a where 
a > Ois any constant. 


5. (i) Apply Euler’s method to 
y=x+y), y(0)=1. 
Take h = 0.25, and do four steps, obtaining an approximation for y(1). 
(ii) Take h = 0.2, and do five steps of Euler’s method, obtaining another 
approximation for y(1). 


(iii) Solve the above problem exactly, and determine which one of the two 
approximations is better. 


6. Write a computer program to implement Euler’s method for 


y= fy) Yo) = Yo- 
It involves a simple loop: y,41 = yn + hf(Xo + nh, yy), n = 0, 1, 2,.... 


1.8* The Existence and Uniqueness Theorem 
In this section, for the initial value problem 


= f(x,y), 
W(X) = Yo. 


we prove a more general existence and uniqueness theorem than Theorem |1.6.1|stated 
above. 

Define a rectangular box B around the initial point (xo, yo) to be the set of points 
(x, y), satisfying x» -a<x<xX)+aandy—b<y < yo +5, for some positive a and 
b. It is known from calculus that in case f(x, y) is continuous on B, it is bounded on B, 
so that for some constant M > 0 


(1.8.1) 


|f(~.y)| <M, for all points (x, y) in B. (1.8.2) 


Theorem 1.8.1. Assume that the function f(x, y) is continuous on B and for some con- 
stant L > 0, it satisfies (the Lipschitz condition) 


|f (2% y2) — FO W)| S Lya — vil; (1.8.3) 
for any two points (x, y,) and (x, yz) in B. Then the initial value problem G8.) 1.8.1) has a 
unique solution, which is defined for x on the interval (x — -, Xo + re in case = <a, 


and on the interval (xp — a, Xp + a) if — > a. 
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Proof. Assume, for definiteness, that ze < a, and the other case is similar. We shall 
prove the existence of solutions first, and let us restrict ourselves to the case x > Xq 
(the case when x < Xp is similar). Integrating the equation in over the interval 
(Xo, x), we convert the initial value problem into an equivalent integral equation 


x 
yod=w+ [far orar (1.8.4) 
40) 
(If y(x) solves (1.8.4), then y(xo) = yo, and by differentiation y’ = f(x, y).) By (1.8.2), 
obtain 


—M < f(t, y(t)) < M, (1.8.5) 


and then any solution of lies between two straight lines 
Yo — M(x — Xq) S V(X) S Vo + M(x — Xp). 


b ; . er 
For X¥9 < xX < Xp + ar these lines stay in the box B, reaching its upper and lower 


: b b ‘ . 
boundaries at x = X9 + ri (In the other case, when — > a, these lines stay in B 


for all x9 < x < X) +a.) We denote g(x) = yo + M(x — xq) and call this function a 
supersolution, while p(x) = yo — M(x — Xp) is called a subsolution. 


J 
Yotbe 
Yo @ 
Yo—b 
© e e > X 
Xp —a Xo Xp ta 


The functions g(x) and (x) exiting the box B. 


1. A special case. Let us make an additional assumption that f(x, y) is increasing in 
y, so that ify. > y,, then f(x, y.) > f(x, y,), for any two points (x, y,) and (x, y2) in B. 
We shall construct a solution of (1.8.1) as the limit of a sequence of iterates 7b(x), y, (x), 
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Y7(X), ---> Yn (xX), ..., defined as follows: 


iQ) =o + i, f(t. wo) dt, 


Y2(X) = Yo + / f(t, yi) dt, 


Yn(X) = Yo + / f(t, Yn_1(t)) dt. 


We claim that for all x on the interval x9 < x < x9 + ~, the following inequalities 
hold: 


P(x) S W(X) S$ yo(X) S++ S n(x) S-. (1.8.6) 
Indeed, f(t, p(t)) => —M, by (1.8.5), and then 


owe i F(t, P(t) dt > yy — M(x — x9) = Wo), 


giving us the first of the inequalities in (1.8.4). Then 


wo) — 9,0) = i Lft.yn(t) — f(t, P@O)] dt > 0, 


xo 
using the just established inequality p(x) < y,(x) and the monotonicity of f(x, y), so 
that y,(x) < y2(x) and the other inequalities in are established similarly. Next, 


we claim that for any x on the interval x9 < x < Xp + ~, all of these iterates lie below 
the supersolution 9(x), so that 


W(x) < y(X) S yo(x) S++ S Wy(X) S++ < G(X). (1.8.7) 
Indeed, f(t, p(t)) < M, by (L-8-5), giving 


WO) =I + [ F(t, P@) dt < yo + M(x — x) = (0), 


proving the first inequality in and that the graph of y,(x) stays in the box B for 
Xo <X SX + |. Then 


0) = Yo + [ Flt,yx(O) dt < yo + M(x — Xo) = G(X, 


and so on, for all y,,(x). 
Ateach x in (xg, Xp + ~), the numerical sequence {y,, (x)} is nondecreasing, bound- 


ed above by the number g(x). Hence, this sequence has a limit which we denote by 
y(x). The sequence f(x, y,(x)) is also nondecreasing, and it converges to f(x, y(x)). 
By the monotone convergence theorem, we may pass to the limit in the recurrence 
relation 


Ya) = Ip + i, Flt. Yn_a(d)) dt, (1.8.8) 


concluding that y(x) gives the desired solution of the integral equation ({1.8.4). 
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(If one starts the recurrence relation ({1.8.8]) with the supersolution $(x), one ob- 
tains similarly a decreasing sequence of iterates converging to a solution of ((1.8.4)).) 


2. The general case. Define g(x, y) = f(x, y)+ Ay. If we choose the constant A large 
enough, then the new function g(x, y) will be increasing in y, for (x,y) € B. Indeed, 
using the Lipschitz condition (1.8.3), 
8(%, Yo) — 82 V1) = FO Y2) — FO M1) + A D2 — YW) 

2 -L02-¥1) tAQ2 - i) 

= (A-L)0Q2- 1) 

> 0, 
for any two points (x, y,) and (x, y,) in B, provided that A > L and y, > y,. We now 
consider an equivalent equation (recall that g(x, y) = f(x, y) + Ay) 

y' + Ay = f(xy) + Ay = g(x,y). 

Multiplying both sides by the integrating factor e4*, we put this equation into the form 


d eA ‘acai x 
ay Letty] = ea, y)- 


Set z(x) = e4*y(x); then y(x) = e~4*z(x), and the new unknown function z(x) satis- 


fies 
z= 2°" 9(x,e **z), 
2(Xq) = e4* yo, 
The function e4*g (x eo o*z) is increasing in z. The special case applies, so that the 
solution z(x) of exists. Then y(x) = e~4*z(x) gives the desired solution of 


((1.8.1)). 
Finally, we prove the uniqueness of solution. Let u(x) be another solution of 


(1.8.9) 


. b 
on the interval (x9, Xp + uu” so that 


x 
ux) =o + [ f.u(oyae 
xo 
Subtracting this from ({1.8.4) gives 


y(x) — u(x) = ‘i fy) — ft, ut))] dt. 


40) 


Assume first that x is in [x9, Xp + ae Then using the Lipschitz condition (1.8.3), we 
estimate 


Iy(x) — u(x) < / If(t, yO) — f(t, ut))| dt 


a5 i v(t) — u(t)| at 


< L(x =x) max, [y(x) - u(x) 
[xo.x0+s-] 


1 
<5 max, |y(x)— u(x). 
[xo.Xo+ 57] 
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It follows that 


1 
max, [ye)—uGd| <5 max, |yx) — u(x). 
[xo,x0+ 7] [xo.x0+ 57] 
1 
But then MAX xt] |y(x) — u(x)| = 0, so that y(x) = u(x) on [X9,X9 + xl Let 


2L 
: 1 : : 
X, =X + =. We just proved that y(x) = u(x) on [x9, Xo + all and in particular 


y(x1) = u(x). Repeating (if necessary) the same argument on [x,, x, + =) and so on, 


we will eventually conclude that y(x) = u(x) on (x9, Xp + ~), © 


Observe that the Lipschitz condition follows from the easy to check require- 
ment that the function f,(x, y) is continuous in the box B. 
We shall need the following important tool. 


Lemma 1.8.1 (Bellman-Gronwall Lemma). Assume that for x > Xo, the functions u(x) 
and a(x) are continuous and satisfy u(x) > 0, a(x) > 0. Assume that for some number 
K > 0 we have 
x 
u(x) <K+ i a(t)u(t)dt, forx > Xp. (1.8.10) 
xo 
Then 


a(t) dt 


u(x) < Ke!xo for x > Xo. (1.8.11) 


Proof. Divide the inequality by its right-hand side (which is positive) 


OFLC, < aly). 
K+ naa a(t)u(t) dt 


Integrating both sides over (xo, x) (the numerator of the fraction on the left is equal to 
the derivative of its denominator) gives 


In (k +f a(t)u(t) a) —-Ink< ‘i a(t) dt, 


xo 40) 


which implies that 


x 
i / a(t)u(t)dt < Ke/*o a(t) dt 


40) 
Using the inequality (1.8.10) once more, we get ({1.8.11). © 


In addition to the initial value problem (1-8-1), with f(x, y) satisfying the Lipschitz 

condition ({1.8.3), consider 
z' = f(x, 2), 
2(Xo) = Zo. 

If Z9 = Yo, then z(x) = y(x) for all x € B, by the Theorem (observe that the 
Lipschitz condition implies the continuity of f(x, y) on B). Now suppose that 
Zo # Yo, but |Z — yo| is small. We claim that z(x) and y(x) will remain close over any 
bounded interval (x9, Xo + p), provided that both solutions exist on that interval and 
|Z9 — Yo| is small enough. This fact is known as the continuous dependence of solutions, 
with respect to the initial condition. 


(1.8.12) 
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We begin the proof of the claim by observing that z(x) satisfies 


x 
2X) = Zy + / f(t, 2(t)) dt. 
xo 
From this formula we subtract (1.8.4) and then estimate 


2(x) — W(x) = 2) —Jo + / Lftt, 2(t)) — f(t. »(@)] dt: 


40) 


[Z(x) — yx) < |Zo — Yol +f If(t,2(t)) — Fy) at 


Si eyale [ Lla(t) — y(0)| dt. 


xo 
(We used the triangle inequality for numbers: |a + b| < |a| +|b], the triangle inequality 
for integrals: | fies g(t) dt| < i. |g(t)| dt, and the condition ({1.8.3).) By the Bellman- 
Gronwall lemma 
[z(2) — yO) < lzo — Yole“*-* < |zo — yole””, for x € (xq, Xo + P)s 


so that z(x) and y(x) remain close over the interval (xg, Xp + p), provided that |Z) — yo| 
is small enough. 


1.8.1 Problems. 


1. Assume that the function u(x) > 0 is continuous for x > 1, and for some number 
K > 0, we have 


x 
xu(x) <K+ / u(t)dt, forx >1. 
1 
Show that u(x) < K, for x > 1. 


2. Assume that the functions a(x) > 0 and u(x) > 0 are continuous for x > x9 and 
that we have . 
u(x) < [ a(t)u(t)dt, forx > Xp. 
xo 
Show that u(x) = 0, for x > x9. Then give an alternative proof of the uniqueness 
part of Theorem [1.8.1 


Hint. Let K > 0 in the Bellman-Gronwall lemma. 


3. Assume that the functions a(x) > 0 and u(x) > 0 are continuous for x > x, and 
that we have : 
u(x) < i a(t)u?(t)dt, forx > Xp. 
xo 
Show that u(x) = 0, for x > xp. 


Hint. Observe that u(x)) = 0. When t is close to xg, u(t) is small. But then 
u(t) < u(t). (Alternatively, one may treat the function a(t)u(t) as known and 
use the preceding problem.) 
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Show that if a function x(t) satisfies 
0< a <x? forallt, andx(0)=0, 


then x(t) = 0 for all t € (—oo, 00). 


Hint. Show that x(t) = 0 for t > 0. In case t < 0, introduce new variables y and s 
by setting x = —y and t = —s, so that s > 0. 


. Assume that the functions a(x) > 0 and u(x) > 0 are continuous for x > x, and 


that we have 


u(x) <K+ / a(t)[u(t)]” dt, for x > Xo, (1.8.13) 


xo 
with some constants K > 0 and 0 < m < 1. Show that 


1 


x i-m 
u(x) <|K'-™ + - m) [ a(t) | , for x > Xp. 
40) 


This fact is known as Bihari’s inequality. Show also that the same inequality holds 
in case m > 1, under an additional assumption that 


x 
Khe™+—- m) [ a(t)dt>0, forallx > xp. 
Xo 


Hint. Denote the right-hand side of (1.8.13) by w(x). Then w(x) = K, and 
w’ = a(x)u™ < a(x)w™. 


Divide by w™, and integrate over (Xo, x). 


. For the initial value problem 


y =f@y), YX) = yo; 


or the corresponding integral equation 


coe / Flt. y(0) at, 


the Picard iterations are defined by the recurrence relation 


x 
Yas) =Yo+ ; Flt.yq(t) dt, 2 =0,1,2,~, 
Xo 


starting with yo(x) = yo. (Picard’s iterations are traditionally used to prove the 
existence and uniqueness theorem, Theorem [1.8.1] ) 
(i) Compute the Picard iterations for 
y=y, y0)=1, 


and compare them with the exact solution. 
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(ii) Compute the Picard iterates y,(x) and y,(x) for 
y' =2xy’, y0)=1, 


and compare them with the exact solution, for |x| small. 


Hint. The exact solution may be written as a series y(x) = 1+x?+x4+x°+---, 


Answer. yo(x) = 1, y\(x) =14+ x’, w(x) =14+ x7 +x44 * The difference 
ly(x) — y2(x)| is very small, for |x| small. 


7. Let y(x) be the solution for x > 0 of the equation 


y = fy), yO) =yo. 
Assume that | f(x, y)| < a(x)|y| + b(x), with positive functions a(x) and b(x) sat- 
isfying Ie a(x)dx < ow, ie b(x)dx < oo. Show that |y(x)| is bounded for all 
x>0. 


Hint. Apply the Bellman-Gronwall lemma to the corresponding integral equation. 


8. Assume that for x > x, the continuous functions y(x), f(x), and g(x) are nonneg- 
ative and 4 
yo) < f0)+ [ gOvDdt, for x > xo 


40) 


Show that 


y(x) < f(x) + ii a(t) fet 8 dt, for x > Xp. 


xo 


Hint. Denote I(x) = Se g(t)y(t) dt. Since I'(x) = g(x)y(x) < g(x)I(x) + g(x) f(x), 
it follows that 
re [en 9 8M Ia] < oF g(x) F(x), 


Integration over [xp, x] gives I(x) < Hiss g(t) fi (teh gtu)du dr, 


Second-Order Equations 


The central topic of this chapter involves linear second-order equations with constant 
coefficients. These equations, while relatively easy to solve, are of great importance, 
particularly for their role in modeling mechanical and electrical oscillations. Several 
sections deal with such applications. Some nonstandard applications are also included: 
the motion of a meteor, coupled pendulums, and the path of a military drone. Then 
we study Euler’s equation with variable coefficients and higher-order equations. The 
chapter concludes with the more advanced topic of oscillation theory. 


2.1 Special Second-Order Equations 
Probably the simplest second-order equation is 

y"(x) = 0. 
Take the antiderivative 

y (x) =¢. 


We denoted an arbitrary constant by c,, because we expect another arbitrary constant to 
make an appearance. Indeed, taking another antiderivative, we get the general solution 


W(X) = CyX + Cp. 


This example suggests that general solutions of second-order equations depend on two 
arbitrary constants. 

General second-order equations for the unknown function y = y(x) can often be 
written as 


y” = fxy,y’), 
where f is a given function of its three variables. One cannot expect all such equa- 
tions to be solvable, as we could not even solve all first-order equations. In this section 


we study special second-order equations, which are reducible to first-order equations, 
greatly increasing their chances to be solved. 
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2.1.1 y Is Not Present in the Equation. Let us solve for y(t) the equation 


ty” —y' =??. 
The derivatives of y are present in this equation, but not the function y itself. We denote 
y(t) = v(t), and v(t) is our new unknown function. Clearly, y’(t) = v’(t), and the 
equation becomes 

to’ -v=??, 
This is a first-order equation for u(t)! This equation is linear, so that we solve it as 


usual. Once v(t) is calculated, the solution y(t) is determined by integration. Here are 
the details: 


re | 
v—-v=t, 
t 
-fidt_ int _ jin? _ 1 
th=e “t' =e =e t=-, 
M(t) ; 
d fl 
—|-v]=1, 
(7° 
1 
ra =ftt+ Ci, 
y=v=eP+et, 
t t? 
thh=—+c¢q~+&. 
y(t) 3 15 2 
Here c, and c, are arbitrary constants. 
For the general case of equations with y not present 
y" = fy’), 
the change of variables y’ = v results in the first-order equation 
v’ = f(x, v). 
Let us solve the following equation for y(x): 
y’ + 2xy? =0. 
Again, y is missing in this equation. Setting y’ = v, with y” = v’, gives a first-order 
equation: 
v’ + 2xv? = 0, 
dv 
— = —2xv?, 
dx 


The last equation has a solution v = 0, or y’ = 0, giving y = c, the first family of 
solutions. Assuming that v ¥ 0, we separate the variables 


[ Ga [ 2xax, 
U 
ast 


= 2 
ooo —C, 
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Let us now assume that c, > 0. Then 


y(x) = | dx = s arctan —~ +c 
i = es aR > — 2° 
x? oh Cy af Cy af Cy 
the second family of solutions. If c, = 0 or c; < 0, we get two more different formulas 
. ‘ i : : . 1 
for solutions! Indeed, in case c, = 0, or y’ = =» an integration gives y = —- + ¢3, the 
x x 
third family of solutions. In case c, < 0, we can write (replacing c, by —c?, with a new 


C1) 
ies 1 he i 
x2—¢c2 (x-G)\(x+q) 2c, |x-c) xtc] 


y = 
Integration gives the fourth family of solutions 


s4 In |x — c,| u In |x + c¢|+¢ 
amor 1 2c 1 4: 


Prescribing two initial conditions is appropriate for second-order equations. Let 
us solve 


y"+2xy=0, y(0)=0, y(0)=1. 
We just solved this equation, so that as above 


; 1 
y (x) = +O, 


From the second initial condition, y’(0) = += 1, giving c, = 1. It follows that y’(x) = 
Cy 


= and then y(x) = arctan x + c,. From the first initial condition, y(0) = c, = 0. 
x 


Answer. y(x) = arctan x. 
2.1.2 x Is Not Present in the Equation. Let us solve for y(x) 


ay i 
y" +yy" =0. 


All three functions appearing in the equation are functions of x, but x itself is not 
present in the equation. On the curve y = y(x), the slope y’ is a function of x, but 
it is also a function of y. We set y’ = v(y), and v(y) will be the new unknown function. 
By the chain rule 


ye) = Zu) = vn & =v, 
and our equation takes the form 
v'v + yu? = 0. 
This is a first-order equation! To solve it, we begin by factoring 
v(v' + yu’) =0. 


If the first factor is zero, y’ = v = 0, we obtain a family of solutions y = c. Setting the 
second factor to zero, 


peace 2 
dy + yv 0, 
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gives a separable equation. We solve it by separating the variables 


dv 
- [B= f vay, 


oe _ y+ 2e 
‘ipa a oe ee 
d 
SS, 
x y* + 2c) 
To find y(x) we need to solve another first-order equation (2 = = ). Separating 
Ee y*+2c 
the variables, : 
[oe + 2c,) dy = [rex 
y3/3 + 2cyy = 2x +c, 
we obtain a second family of solutions. 
For the general case of equations with x not present 
y" =fO.y), 
the change of variables y’ = u(y) produces a first-order equation for v = v(y) 
vu' = f(y, v). 


Let us solve for y(x): 


y=yy', y0)=-2, y'(0)=2. 


In this equation x is missing, and we could solve it as in the preceding example. Instead, 
write this equation as 


and integrate, to get 
, 1 
y'@) = 5¥°@) +a, 
Evaluate the last equation at x = 0, and use the initial conditions: 
1 
2= 5 (-2)° + Ci, 


so that c; = 0. Then 


dy _l1., 
de 
Solving this separable equation gives y = — 7 as Using the first initial condition 
yXtc2 


: 1 
again, calculate c, = 5 


2 
Answer. y = Say: 
x 
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2.1.3* The Trajectory of Pursuit. 

Problem. A car is moving along a highway (the x-axis) with a constant speed a. A 
drone is flying in the sky (at a point (x, y), which depends on time f), with a constant 
speed v. Find the trajectory for the drone, so that the tangent line always passes through 


the car. Assume that the drone starts at a point (xo, yo) and the car starts at Xq. 


Solution. IfX gives the position of the car, we can express the slope of the tangent line 


as follows (2 = — tan, where 6 is the angle the tangent line makes with the x-axis): 
d 
- = = . (2.1.1) 


(2.1.2) 
On the other hand, v = =, and ds = dx? + dy?, so that 
2 
1 1 1 dx 
= = 2 2=> psu 
dt 5 os 5 Vax +dy = (Fe) +1dy, 
and then 
2 
dt 1 dx 
ar (5) 4; (2.1.3) 


(Observe that < < 0, so that minus is needed in front of the square root.) Comparing 
y 


x 


* ea d d? 3 - 
with and writing x’(y) = oe x"(y) = = we arrive at the equation of 


yx"(y) = = xy) +1. 


motion for the drone: 
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The unknown function x(y) is not present in this equation. Therefore set x'(y) = p(y), 
with x”(y) = p’(y), obtaining a first-order equation for p(y), which is solved by sepa- 
rating the variables: 

dp _ a 


oe 2 
Vay . p* +1, 


dp__4 / dy 
Jet+l Ls Y 
The integral on the left is computed by the substitution p = tan 6, giving 


In(p+ Vp? +1) = = (Iny + Inc), 


p+ p2 +l=cy» (withanewc). 


Vp? +l=cye—p (2.1.4) 


Write the last formula as 


and square both sides, getting 
2a a 
l=c*yv —2cyvp. 
Solve this for p = x'(y): 
x'( —— —! = 
= ge gee. 


The constant c we determine from (2.1.4). At t = 0, p = x'(yo) = 0, and soc = Yo". 
(At t = 0, the drone is pointed vertically down, because the car is directly under it.) 


Then 4 7 
= 5 (2) -3(2) ° 
x ==-(—) -=(— ; 
=F \ 95) 7 3\55 


Integrating and using that x(yp) = xq, we finally obtain (assuming v # a) 
y y\ito y y\re 
0 e 0 vD 
=o _|(- a ee =i 
= 2+ ale) (2) | 21 = a/v) (2) | oe 


2.2 Linear Homogeneous Equations with Con- 
stant Coefficients 
We wish to find solution y = y(t) of the equation 
ay” + by'+cy =0, (2.2.1) 


where a, b, and c are given numbers. This is arguably the most important class of 
differential equations, because it arises when applying Newton’s second law of motion 
(or when modeling electric oscillations). If y(t) denotes displacement of an object at 
time t, then this equation relates the displacement with velocity y’(t) and acceleration 
y"(t). The equation is linear, because it involves a linear combination of the 
unknown function y(t) and its derivatives y’(t) and y(t). The term homogeneous refers 
to the right-hand side of this equation being zero. 

Observe that if y(t) is a solution, then so is 2y(t). Indeed, substitute 2y(t) into the 
equation: 

a(2y)” + b(2y)’ + c(2y) = 2(ay” + by’ + cy) = 0. 
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The same argument shows that c, y(t) is a solution for any constant c,. If y,(¢) and y(t) 
are two solutions, a similar argument will show that y,(t) + y2(t) and y,(t) — y(t) are 
also solutions. More generally, a linear combination of two solutions, c, y;(t) + c2y2(t), 
is also a solution, for any constants c, and cz. Indeed, 


a (yy (t) + Coy2(t)) + bc) + Cay) + ¢ (Cry) + C2y2(t)) 
= (ayy + by, + cy) + C2 (ay; + bys + cy) = 0. 
This fact is called the linear superposition property of solutions. 
We now try to find a solution of the equation (2.2.1) in the form y = e’’, where r is 
a constant to be determined. We have y’ = re” and y” = r’e", so that the substitution 
into the equation (2.2.1) gives 
a(r?e"") + b(re”) + ce’ = e” (ar? + br +c) =0. 
Dividing by a positive quantity e”, obtain 
ar*+br+c=0. 
This is a quadratic equation for r, called the characteristic equation. If r is a root (solu- 
tion) of this equation, then e” solves our differential equation (2.2.1). When solving a 


quadratic equation, it is possible to encounter two real roots, one (repeated) real root, 
or two complex conjugate roots. We shall look at these cases in turn. 


2.2.1 The Characteristic Equation Has Two Distinct Real Roots. Assume 
that the roots j and 7, are real and m # 4. Then e™ and e’2! are two solutions, and 
their linear combination gives us the general solution 


y(t) = cye"™ +. coe"!, 


As there are two constants to play with, one can prescribe two additional conditions 
for the solution to satisfy. 


Example 2.2.1. Solve 
y” +4y' + 3y = 0, 
y(0) = 2, 
y¥(0) =-1. 
Assuming that y(t) gives displacement of a particle, we prescribe that at time zero the 
displacement is 2 and the velocity is —1. These two conditions are usually referred to as 


the initial conditions, and together with the differential equation, they form an initial 
value problem. The characteristic equation is 


r?+4r+3=0. 


Solving it (say by factoring as (r + 1)(r + 3) = 0) gives the roots, = —land 4% = —3. 
The general solution is then 


1) =e" +e", 


t 3 


Calculate y(0) = c, +c. Compute y’(t) = —ce7 ‘and therefore y’(0) = 


—Cc, — 3cz. The initial conditions tell us that 


— 3c,e7 


cy +c, = 2, 


—Cy = 3c, = —1. 
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We have two equations to find two unknowns c and cj. Obtain c, = 5/2 and c, = —1/2 
(say by adding the equations). 

5,-t _ 1,-3t 
Answer. y(t) = soo Se 


Example 2.2.2. Solve 


y" —4y =0. 
The characteristic equation is 
r?—4=0. 
Its roots are 4 = —2 and % = 2. The general solution is then 


y(t) = cye~*! + ce”. 
More generally, for the equation 
y" —a’y=0 (aisagiven constant), 
the general solution is 
y(t) = ce~@ + coe™. 


This should become automatic, because such equations appear often. 


Example 2.2.3. Find the constant a, so that the solution of the initial value problem 


9y"-y=0, y0)=2, yO)=a 
is bounded as t > oo, and find that solution. 
We begin by writing down (automatically!) the general solution 


oly 1, 
y(t) =cye 3 +09e3. 


1 1 
Compute y’(t) = See ao 4 30203", and then the initial conditions give 
yO) = c, +c, = 2, 
; i. '¢ 
y (0) = = gel + 302 =a. 


Solving this system of two equation for c, and c, (by multiplying the second equation 
through by 3 and adding the result to the first equation) gives cp) = 1+ a and c; = 


1- =a. The solution is 


1 


1 
y(t) = (1 — sa)e" + (1 + sa)er 


1 
In order for this solution to stay bounded as t — oo, the coefficient in front of e3' must 
1 
be zero, so that 1 + a = 0 and a = —2. The solution then becomes y(t) = oe 3 


3 
Finally, recall that if, and 7, are roots of the characteristic equation, then we can 
factor the characteristic polynomial as 


ar? +br+c=a(r—n)(r—n). (2.2.2) 
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2.2.2 The Characteristic Equation Has Only One (Repeated) Real Root. 
This is the case when % = 7. We still have one solution y,(t) = e”!'. Of course, any 
constant multiple of this function is also a solution, but to form a general solution we 
need another truly different solution, as we saw in the preceding case. It turns out that 
y2(t) = te is that second solution, and the general solution is then 
y(t) = cye"! + cote™. 
To justify that y(t) = te”! isa solution, we begin by observing that in this case the 


formula becomes 

ar? + br+c=a(r—H)’. 
Square out the quadratic on the right as ar? — 2anr + ar?. Because it is equal to the 
quadratic on the left, the coefficients of both polynomials in r2, r, and the constant 
terms are the same. We equate the coefficients in r: 


b = —2an. (2.2.3) 


To substitute y,(t) into the equation, we compute its derivatives y3(t) =e"! +nte! = 
e"' (1 + yf), and similarly y3(t) =e! (2, + rt). Then 


ay; + by; + cy, = ae (2 +17 t) + be (1 + yf) + cte™ 
=e"! (2ar, + b) + te (ar? + br, +c) 
= 0. 


In the second line, the first bracket is zero because of (2.2.3), and the second bracket is 
zero because 1, solves the characteristic equation. 


Example 2.2.4. Solve 9y” + 6y’ + y = 0. 
The characteristic equation 


or? +6r+1=0 


has a double root r = -*. The general solution is then 


lt 1} 
y(t) =cye 3 +cote 3. 
Example 2.2.5. Solve 
y" —4y' + 4y =0, 


yO) = 1, 
y'(0) = -2. 
The characteristic equation 
r?—4r+4=0 


has a double root r = 2. The general solution is then 
y(t) = ce*4 + cyte”. 
Here y’(t) = 2c,e”* + ce”! + 2c,te*, and from the initial conditions 
y(0) =¢, = 1, 
y' (0) = 2c, + cy = -2. 


From the first equation, c; = 1, and then c, = —4. 


Answer. y(t) = e*! — 4te”!, 
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2.3 The Characteristic Equation Has Two Com- 
plex Conjugate Roots 

In this section we complete the theory of linear equations with constant coefficients. 

The following important fact will be needed. 

2.3.1 Euler’s Formula. Recall Maclauren’s formula 


e=14+z+ > 72 +123 sin + 425 +? 
~ 2! 3! 4! 5! 


Let z = i@, where i = /—1 is the imaginary unit and 6 is a real number. Calculating 
the powers and separating the real and imaginary parts gives 


el =14+i0+ 5 (06)? + = (00) + (10) + =(i8)° + 


= 1410-56 - Ti8 + 20+ + Tio? + 


= Ly. los ‘ 143, Las 
=(1- ae + Ze + )+i(e- 50 +36 + ) 
= cos @ + isin 0. 
We derived Euler’s formula: 
e — cos + isiné. (2.3.1) 
Replacing 6 by —86, gives 
e~® — cos(—0) + isin(—@) = cos 6 — isin @. (2.3.2) 
Adding the last two formulas, we express 
i@ , ,-id 
cos 0 = — (2.3.3) 
Subtracting from (2.3.1) the formula and dividing by 2i, 
gO _ eid 
sin @ = —3 (2.3.4) 
The last two formulas are also known as Euler’s formulas. 
2.3.2 The General Solution. Recall that to solve the equation 
ay" + by’+cy =0 (2.3.5) 


one needs to solve the characteristic equation 
ar*+br+c=0. 


Assume now that its roots are complex. Complex roots come in conjugate pairs: if 
p + iq is one root, then p — iq is the other, and we may assume that q > 0. These roots 
are, of course, different, so that we have two solutions z, = etigt and Z2 = e(P—igt, 
The problem with these solutions is that they are complex-valued. Adding z, +2, gives 
another solution of (2.3.5). Dividing this new solution by 2, we get = a solution, 

so that the function y,(t) = ae 2 is a solution of our equation (2.3.5), and similarly 


aa 


the function y,(t) = is another solution. Using the formula (2.3.3), compute 
a (p—iq)t iqt 4 e—iqt 
e +e et +e 
y(t) = —— ee — = eP' cos qt. 


2.3. The Characteristic Equation Has Two Complex Conjugate Roots 


This is a real-valued solution of our equation! Similarly, 


(ptiq)t _ ,(p—ig)t iqt _ p-iqt 
e e e e ‘ 
ya(t) = —— 3 eer re = eP! sin qt 


is our second solution. The general solution is then 
y(t) = c,e”! cos qt + c,e” sin qt. 
Example 2.3.1. Solve y” + 4y' + 5y = 0. 
The characteristic equation 
r?+4r+5=0 
can be solved quickly by completing the square: 


(r+2)/?+1=0, 


(r +2)? =-1, 
r+2=ti, 
r=—2+i. 
Here p = —2, q = 1, and the general solution is 


2t sin t. 


y(t) = cye~?! cost + c,e7 
Example 2.3.2. Solve y” + y =0. 
The characteristic equation 


rP+1=0 
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has roots +i. Here p = 0 and q = 1, and the general solution is y(t) = c, cost + cz sint. 


More generally, for the equation 
y"+a’y=0 (aisa given constant), 


the general solution is 
y(t) = cy cos at + cy sin at. 


This should become automatic, because such equations appear often. 
Example 2.3.3. Solve 


y" +4y =0, y(7/3) =2, y'(a/3) = —4. 


The general solution is 
y(t) = cy cos 2t + cz sin 2¢. 


Compute y’(t) = —2c, sin 2t + 2cz cos 2t. From the initial conditions 
27 _ 20 1 3 
y(7/3) = c, cos ca +c, sin Bore + rae 2 
2 2 
y (2/3) = —2c, sin = + 2c, cos = = ~V3¢, —( =—-4. 


This gives c, = V3- 1cq= V3+ 1. 


Answer. y(t) = (V3 —1)cos2t + (/3 +1)sin2t. 
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2.3.3 Problems. 


I. Solve the second-order equations, with y missing. 


1. 


II. Solve the second-order equations, with x missing. 


halt 


2y'y" =1. 


2 
Answer. y = £2(x + c)7? + &. 


.xy"+y' =x. 


2 
Answer. y = 7 +c, Inx+c). 


3 
Answer. y = = — x2 4+2x4+ce-* +c. 


_ xy" + 2y’ =(y')*, yA) = 0, y'(1) = 1. 


Answer. y = 2tan"'x— *. 


_ y" +2xy" = 0, yO) = 0, y'(0) = -4. 


| 


Answer. y = In| 
2x+1 


1. yy” — 30’) = 0. 


Answer. 3(yIny—y)+cy = —-x+¢),andy=c. 


yy" +0" =0. 


Answer. y? = c, + Cx (this includes the y = c family). 


. y” = 2yy’, yO) = 0, y'(0) = 1. 


Answer. y = tan x. 


_ y” = 3y*y' +’, yO) = 1, y'(0) = 2. 
e2x 
Answer. y = pane 
” 72 ¥ 
y"y = 2xy", WO) = 1, y'(0) = —4. 


Hint. Write 


” 12 
YYT-Y 


a 12 12 
y"y—y = Qx—-1)y"s = = 2x51; -( 
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Integrating and using the initial conditions, 

1 _1)2 
apps ih Oe) 
y’ 4 4 


ANE 
Answer. y = @2x-1, 


III. Solve the linear second-order equations, with constant coefficients. 


1. 


10. 


y" +4y’ +3y =0. 


Answer. y = c,e! + c,e7*". 


. y” —3y' =0. 


Answer. y = c, + c,e*". 


. 2y"+y'-y=0. 


1 
= =t 
Answer. y=c,e'+c,e2. 


.y’ -3y=0. 


Answer, y = c,e~V* + c,eV, 


. 3y” — 5y’ —2y =0. 


1 
==} 
Answer. y=cye 3 +c ,e'. 


. y" —9y =0, y(0) = 3, y’(0) = 3. 


Answer. y = e~*! + 27", 


. y” +5y’ = 0, y(0) = —1, y’(0) = —10. 


Answer. y = —3 + 2e~*'. 


.y’ +y' —6y = 0, y(0O) = —2, y’(0) = 3. 


Wy £2 3e2t 
Answer. y = —~e ob =: 


. 4y"-y=0. 


AL a 
—st st 
Answer. y=cje 2 +c e2. 


3y" — 2y' — y = 0, yO) = 1, y'() = -3. 


Answer. y = 3e7#/3 — 2e', 
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11. 3y” — 2y’—y =0, (0) = 1, y'(0) =a. 
Find the value of a for which the solution is bounded, as t > oo. 


Answer. y = ~(3a + Def — =(a ~1e3, a= -*. 
IV. Solve the linear second-order equations, with constant coefficients. 
1. y” + 6y’ + 9y =0. 


Answer. y = cje~** + cyte". 


2. 4y” —4y'+ y =0. 


1 1 
=t st 
Answer. y=c ,e2 +Cpte2. 


3. y” —2y’' + y =0, y(0) = 0, y’(0) = —2. 
Answer. y = —2te’. 

4. 9y” — 6y’ + y =0, yO) = 1, y'(0) = —2. 
Answer. y = ~0!3(3 — 7t). 


V. 1. Using Euler’s formula, compute: 
(i) elt 
(ii) e7inl2 


5 
= 7 ees 7 
(vi) (cos 2 + isin =) F 
2. Show that sin 20 = 2 sin @cos 6 and cos 20 = cos? 6 — sin? 0. 


Hint. Begin with e!?° = (cos @ + isin 6)’. Apply Euler’s formula on the left, 


and square out on the right. Then equate the real and imaginary parts. 


3.* Show that 


sin 30 = 3cos?@sin@—sin?>@ and cos3@ =—3sin’ @cos6 + cos? 0. 


Hint. Begin with e?° = (cos @ + isin 6)’. Apply Euler’s formula on the left, 


and “cube out” on the right. Then equate the real and imaginary parts. 
VI. Solve the linear second-order equations, with constant coefficients. 
1. y’ +4y’ + 8y =0. 


2 


Answer. y = cje~* cos 2t + c,e~* sin 2t. 
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2. y" + 1l6y = 0. 
Answer. y = c, cos 4t + cy sin 4t. 
3. y” —4y’ + 5y = 0, y(0) = 1, y’(0O) = —2. 
Answer. y = e? cost — 4e” sint. 
4. y" +4y = 0, y(O) = —2, y’(0) = 0. 
Answer. y = —2cos 2t. 
5. 9y” + y =0, y(0) = 0, y'(0) = 5. 
Answer. y = 15sin xt. 


6. y’-y'+y=0. 


i 3 . V3 
Answer. y = e2 (c: cos ey + Cc, sin 21) 


7. 4y”" + 8y' + 5y = 0, y(z) = 0, y'(z) = 4. 


7a —t 


Answer. y = —8e”~* cos st. 


8. y” +y = 0, y(z7/4) = 0, y'(z7/4) = -1. 
Answer. y = —sin(t — 77/4). 


VII. 1. Consider the equation (y = y(t)) 
y" + by’ +cy =0, 
with positive constants b and c. Show that all of its solutions tend to zero, as 
t > ow. 
2. Consider the equation 
y” + by’ —cy = 0, 


with positive constants b and c. Assume that some solution is bounded, as 
t — oo. Show that this solution tends to zero, as t > oo. 


3. Explain why y, = te~‘ and y, = e*! cannot be both solutions of 
ay” + by'+cy =0, 
no matter what the constants a, b, and c are. 
4. Solve the nonlinear equation 


” , 72 
ty"y+yy-—ty =0. 
Hint. Consider the derivative of ay 
y 


Answer. y = c2t°!. 
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2.4 Linear Second-Order Equations with Variable 
Coefficients 


In this section we present some theory of second-order linear equations with variable 
coefficients. Several applications will appear in the following section. Also, this theory 
explains why the general solutions from the preceding sections give all solutions of the 
corresponding equations. 


Linear Systems. Recall that a system of two equations (here the numbers a, b, c, d, 
g, and h are given, while x and y are the unknowns) 

ax + by = g, 

cx+dy=h 


has a unique solution if and only if the determinant of this system is nonzero, 


a 
c 


ao 
Il 


ad — be # 0. This fact is justified by explicitly solving the system: 


xa 28 bh _ Gh=cg 
~ ad — be’ ~ ad —be’ 
It is also easy to justify that a determinant is zero, : = 0, if and only if its 


columns are proportional, so that a = yb and c = yd, for some constant y. 


General Theory. We consider an initial value problem for linear second-order equa- 
tions 
y" + py’ + sOy = fO, 

Y(to) = a, (2.4.1) 

Y'(to) = B. 
The coefficient functions p(t) and g(t) and the function f(t) are assumed to be given. 
The constants to, a, and f are also given, so that at some initial “time” ¢ = fo, the 
values of the solution and its derivative are prescribed. It is natural to ask the following 
questions. Is there a solution to this problem? If there is, is the solution unique, and 
how far can it be continued? 


Theorem 2.4.1. Assume that the functions p(t), g(t), and f(t) are continuous on some 
interval (a, b) that includes ty. Then the problem has a solution, and only one 
solution. This solution can be continued to the left and to the right of the initial point to, 
so long as t remains in (a, b). 


If the functions p(t), g(t), and f(t) are continuous for all t, then the solution can 
be continued for all t, -co < t < oo. This is a stronger conclusion than what we had 
for first-order equations (where blow-up in finite time was possible). Why? Because 
the equation here is linear. Linearity pays! 


Corollary 2.4.1. Let z(t) be a solution of with the same initial data as y(t): z(to) = 
aand z'(ty) = 8. Then z(t) = y(t) forall t. In particular, if y(to) = y'(to) = 0, then 
y(t) = 0 for all t. 


Let us now study the homogeneous equation (for y = y(t)) 


y" + py’ + gy = 0, (2.4.2) 
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with given coefficient functions p(t) and g(t). Although this equation looks relatively 
simple, its analytical solution is totally out of reach, in general. (One has to either 
solve it numerically or use infinite series.) In this section we study some theoretical 
aspects. In particular, we shall prove that a linear combination of two solutions, which 
are not constant multiples of one another, gives the general solution (a fact that we 
intuitively used for equations with constant coefficients). The equation always 
has a solution y(t) = 0 for all t, called the trivial solution. We shall study primarily 
nontrivial solutions. 

We shall need a concept of the Wronskian determinant of two functions y(t) and 
y,(t), or the Wronskian, for short: 

w= |e 2 [= nO - Ono 

(named in honor of Polish mathematician J. M. Wronski, 1776-1853). Sometimes the 
Wronskian is written as W(y,, y,)(t) to stress its dependence on y,(t) and y,(t). For 
example, 


cos 2t sin 2t 


W(cos 2t, sin 2t)(t) = | —2sin2t 2cos2t 


| = 2.cos? 2t + 2sin” 2t = 2. 

Given the Wronskian and one of the functions, one can determine the other one. 
Example 2.4.1. If f(t) = t and W(f, g)(t) = te’, find g(t). 

Solution: Here f’(t) = 1, and so 


tf pO 
1 gi) 


This is a linear first-order equation for g(t). We solve it as usual, obtaining 


W(f,g)(t) = = tg’(t) — g(t) = te’. 


g(t) = te’ +ct. 

If g(t) = cf(t), with some constant c, we compute that W(f,g)(t) = 0, for all t. 
The converse statement is not true. For example, the functions f(t) = t? and 
 ifiSu, 

-? ift<0 


«=| 


are not constant multiples of one another, but W(f,g)(t) = 0. This is seen by com- 
puting the Wronskian separately in case t > 0 and for t < 0. (Observe that g(t) is a 
differentiable function, with g’(0) = 0.) 


Theorem 2.4.2. Let y,(t) and y(t) be two solutions of (2.4.2), and W(t) is their Wron- 
skian. Then 

W(t) = ce SPO at, (2.43) 
where c is some constant. 


This is a remarkable fact! Even though we do not know y,(t) and y,(t), we can 
compute their Wronskian. 


Proof. Differentiate the Wronskian W(t) = y,(t)y3(t) — yi ()y2(0): 
W' = Vio + Via — Vida — Vis = V2 — iyo 
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Because y, is a solution of (2.4.2), we have y/ + p(t)y; + g(y, = 0, or y! = —p(t)y, -— 
g(t)y,, and similarly y; = —p(t)y, — g(t)y2. With these formulas, we continue: 


W' = y, (—P(t)y2 — g(O)y2) — (—PM yi — g(f)y1) y2 
= —p(t) Wy2 — Viy2) = —p(t)W. 


We obtained a linear first-order equation for W(t), W' = —p(t)W. Solving it gives 
(2.4.3). © 


Corollary 2.4.2. We see from (2.4.3) that either W(t) = 0 for all t, when c = 0, or else 
W(t) is never zero, in case c # 0. 


Theorem 2.4.3. Let y,(t) and y,(t) be two nontrivial solutions of (2.4.2), and W(t) is 
their Wronskian. Then W(t) = 0 for all t if and only if y(t) and y(t) are constant 
multiples of each other. 


We just saw that if two functions are constant multiples of each other, then their 
Wronskian is zero, while the converse statement is not true, in general. But if these 
functions happen to be solutions of (2.4.2), then the converse statement is true. 


Proof. Assume that the Wronskian of two solutions y,(t) and y,(t) is zero. In partic- 
ular, it is zero at any point fo, so that 


ito) Ya(to) | _ 0 

Yi (to) y4(to) 
When a 2 X 2 determinant is zero, its columns are proportional. Let us assume the 
second column is equal to y times the first one, where y is some number, so that y2(t)) = 
vyi(to) and y5(to) = yyj (to). We may assume that y # 0, because otherwise we would 
have y2(to) = y(to) = 0, and then y,(t) would be the trivial solution, contrary to our 
assumptions. Consider the function z(t) = y,(t)/y. This function is a solution of the 
homogeneous equation (2.4.2), and it has initial values z(tp) = y (to) and z'(to) = 
yi(to), the same as y,(t). By Corollary it follows that z(t) = y,(t), so that y,(t) = 
yy, (t), for all t. © 


Definition. We say that two solutions y,(t) and y,(t) of form a fundamental 
set if for any other solution z(t), we can find two constants c? and c$, so that z(t) = 
c?y,(t) + c3y(t). In other words, the linear combination c,y,(t) + c2y2(t) gives us all 


solutions of (2.4.2). 


Theorem 2.4.4. Let y,(t) and y,(t) be two solutions of that are not constant mul- 
tiples of one another. Then they form a fundamental set. 


Proof. Let y(t) be any solution of the equation (2.4.2). Let us try to find the constants 
c, and c3, so that z(t) = c,y, (t) + c2y2(t) satisfies the same initial conditions as y(t), so 
that 

Z2(to) = C1 yi (to) + C2Y2(to) = V(to)s 

2! (to) = C1 Yj (to) + C2Y3(to) = Y' (to). 
This is a system of two linear equations to find c, and c,. The determinant of this system 
is just the Wronskian of y,(t) and y,(t), evaluated at tg. This determinant is not zero, 
because y(t) and y2(t) are not constant multiples of one another. (This determinant is 


(2.4.4) 
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W(to). If W(to) = 0, then W(t) = 0 for all t, by Corollary and then by Theorem 
y,(t) and y,(t) would have to be constant multiples of one another, contrary to 
our assumption.) It follows that the 2 x 2 system has a unique solution c, = c?, 
c, = c9. The function z(t) = c®y,(t) + c2y,(t) is then a solution of the same equation 
(2.4.2), satisfying the same initial conditions, as does y(t). By Corollary 70) = 
z(t) for all t. So that any solution y(t) is a particular case of the general solution c, y, (t)+ 
Cay2(t). © 


Finally, we mention that two functions are called linearly independent if they are 
not constant multiples of one another, so that two solutions y,(t) and y,(t) form a fun- 
damental set if and only if they are linearly independent. 


2.5 Some Applications of the Theory 


We shall give some practical applications of the theory from the last section. But first, 
we recall the functions sinh t and cosh t. 


2.5.1 The Hyperbolic Sine and Cosine Functions. One defines 

e+e! ; e —e-# 
5 and sinht = 5 
In particular, coshO = 1, sinhO = 0. Observe that cosht is an even function, while 


sinh t is odd. Compute 


cosht = 


i cosht = sinht and ba sinh t = cosht. 
dt dt 


These formulas are similar to those for cosine and sine. By squaring out, one sees that 
cosh’ t — sinh” t = 1, for all t. 


(There are other similar formulas.) We see that the derivatives and the algebraic prop- 
erties of the new functions are similar to those for cosine and sine. However, the 
graphs of sinht and cosht look totally different: they are not periodic, and they are 
unbounded; see Figures 2.1] and 2.2, 


Figure 2.1. The cosine hyperbolic function. 
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Figure 2.2. The sine hyperbolic function. 


2.5.2 Different Ways to Write the General Solution. For the equation 
y" -—a’y=0 (2.5.1) 


you remember that the functions e~“ and e™ form a fundamental set and y(t) = 
cje@ + c,e% is the general solution. But y = sinhat is also a solution, because 
y’ = acoshat and y" = a?sinhat = ay. Similarly, cosh at is a solution. It is not 
a constant multiple of sinh at, so that together they form another fundamental set, and 
we have another form of the general solution of (2.5.1): 


y =c, coshat + c, sinh at. 
This is not a “new” general solution, as it can be reduced to the old one, by expressing 


cosh at and sinh at through the exponentials. However, the new form is useful. 


Example 2.5.1. Solve y” — 4y = 0, y(0) = 0, y'(0) = —5. 

Write the general solution as y(t) = c, cosh 2t + cz sinh 2t. Using that coshO = 1 
and sinhO = 0 gives y(0) = c,; = 0. With c,; = 0, we update the solution: y(t) = 
c, sinh 2t. Compute y’(t) = 2c, cosh 2t and y’(0) = 2c, = —5, giving c, = -2. 


Answer. y(t) = -: sinh 2t. 


Yet another form of the general solution of (2.5.1) is 
y(t) = cet to) 4 c,elt-to), 
where f, is any number. (Both functions e~@¢~‘0) and e%—‘o) are solutions of (2.5.1).) 
Example 2.5.2. Solve y” — 9y = 0, y(2) = -1, y'(2) = 9. 
We select tg = 2, writing the general solution as 
y(t) = c,e~3¢-2) + ce, e3lt-2), 
Compute y’(t) = —3c,e~3'-2) + 3c,e3-), and use the initial conditions 
cy tc, = —1, 
—3c, + 3c, = 9. 
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Calculate c) = —2andc, = 1. 
Answer. y(t) = —2e73@-2) 4 @3(t-2), 


One can write general solutions, centered at tg, for other simple equations as well. 
For the equation 


y"+a’y=0 
the functions cos a(t — tg) and sin a(t — tg) are both solutions, for any value of ty, and 


they form a fundamental set (because they are not constant multiples of one another). 
We can then write the general solution as 


y =c, cos a(t — fy) +c, sin a(t — fp). 


Example 2.5.3. Solve y” + 4y = 0, y(4) = 2, y¥Q = -6. 
Write the general solution as 


y = ¢,cos2(t- ) +c, sin2(¢— =). 


Using the initial conditions, we quickly compute c, = 2 and cz = —3. 
a : a 
Answer. y = 2cos 2(t — 3) — 3sin2(t — 3) 


2.5.3 Finding the Second Solution. Next we solve Legendre’s equation (for 
-1<t<1) 

(1 — t?)y” — 2ty’ + 2y =0. 
It has a solution y = t. (Lucky!) We need to find another solution in the fundamental 
set. Divide this equation by 1 — ¢?, to put it into the form from the previous 
section: 

Fr 2t, 2 

eT ioe 

Denote another solution in the fundamental set by y(t). By the Theorem we can 
calculate the Wronskian of the two solutions: 
EMO | Mol eet 
1 y(t) 
Set here c = 1, because we need just one solution, which is not a constant multiple of 
the solution y = t. Then 


Wit,y) = 


Spat = e~ In(1-??) = I +. 


ty’-y=e 
This is a linear equation, which is solved as usual: 


Pe 
ara t(1 — t?)’ 


AS a ae 
dt | pa — Py’ a 2(1—t2) ~ 


The last integral was calculated above, by the guess-and-check method, so that 


u(t) = e~ S \tdt = e7 int = dL 


r) 


1 1 1 1 1 l+t 
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Again, we took the constant of integration c = 0, because we need just one solution, 
which is not a constant multiple of the solution y = t. 


Answer. y(t) = ct +c, (-1 + stn =). 


2.5.4 Problems. 


I. 1. Find the Wronskians of the following functions. 
1 
(i) f(t) =e*, g(t) =e" 2". 
Tet 
Answer. = ge? . 
(ii) f@ = e*, g(t) = te**. 
Answer. e*. 
(iii) f(t) = ef cos 3t, g(t) = e! sin 3¢. 
Answer. 3e!, 
(iv) f(t) = cosh 4t, g(t) = sinh 4t. 
Answer. 4. 
2. If f(t) = t? and the Wronskian W(f,g)(t) = te’, find g(t). 
Answer. g(t) = tee! — t7e’ + ct?. 


3. If f(t) =e! and the Wronskian W(f,g)(t) = t, find g(t) given that g(0) = 0. 


os 


—t t 
Answer. g(t) = < + = — a 


4. Assume that f(t) > 0, g(t) > 0, and W(f,g)(t) = 0 for all t. Show that 
g(t) = cf(t), for some constant c. 


/ Uy 
Hint. Express © = I and then integrate. 


5. Let y(t) and y(t) be any two solutions of 
y"—t?y =0. 
Show that W(y,(t), y2(t))(t) = constant. 


II. Express the solution by using the hyperbolic sine and cosine functions. 


1. y" —4y = 0, (0) = 0, y'(0) = -5. 


Answer. y = -* sinh 2t. 
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2. y” —9y = 0, y(0) = 2, y'(0) = 0. 
Answer. y = 2cosh3t. 
3. y” —y =0, y(0O) = —3, y'(0) = 5. 
Answer. y = —3cosht + 5sinht. 
III. Solve the problem by using the general solution centered at the initial point. 
1. y” +y = 0, y(77/8) = 0, y'(z/8) = 3. 
Answer. y = 3sin(t — 77/8). 
2. y" + 4y = 0, y(77/4) = 0, y'(z7/4) = 4. 
Answer. y = 2sin2(t — 2/4) = 2 sin(2t — 2/2) = —2 cos 2t. 
3. y” —2y' —3y =0, v1) = 1, y') = 7. 
Answer. y = 2e3t-) — e~@-)), 
4. y” —9y =0, y(2) = -1, y'2) = 15. 
Answer. y = —cosh 3(t — 2) + 5sinh 3(t — 2). 


IV. For the following equations one solution is given. Using Wronskians, find the sec- 
ond solution and the general solution. 


1. y’-2y' +y=0, y(H=e'. 

2. t?y” — 2ty’ + 2y =0, y,(t) =¢. 
Answer. y = cit + cof. 

3. (1 +¢?)y” — 2ty’ + 2y =0, y(t) =t. 
Answer. y = cyt + ¢,(t? — 1). 

4. (t—2)y” —ty'+2y=0, y( =e'. 
Answer. y = c,e! +c, (—t* + 2t — 2). 


5. ty” +2y'+ty=0, y,() = = 


Answer. y = cj — + Cp 


sint cost 
t 
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ty" —(t+1)y’ —(2t-2)y =0. 
Hint. Search for y,(t) in the form y = e*. 


Answer. y = ce +.¢,(3t + 1)e~*. 


. Show that the functions y, = t and y2 = sint cannot be both solutions of 


y" + pty’ + gy = 0, 
no matter what p(t) and g(t) are. 


Hint. Consider W(),, y,)(0) and then use Corollary 


. Assume that the functions y,; = 1 and y, = cost are both solutions of some 


equation of the form 


y" + py’ + sy = 0. 
What is the equation? 


Hint. Use Theorem to determine p(t) and then argue that g(t) must be 
zero. 


Answer. The equation is 


y” —cotty’ = 0. 


. Let us return to Legendre’s equation 


(1 —t?)y” —2ty’+2y=0, -1l<t<1, 


for which one solution, y, = t, is known. Show that the substitution y = tv 
produces an equation for u(t), which can be reduced to a separable first-order 
equation by letting v’ = z. Solve this equation, to produce the second solution 
y2 in the fundamental set. This technique is known as reduction of order. 


2.6 Nonhomogeneous Equations 


This section deals with nonhomogeneous equations 


y’ + py’ + gy = f(o. (2.6.1) 


Here the coefficient functions p(t) and g(t) and the nonzero function f(t) are given. 
The corresponding homogeneous equation is 


y" + py’ + gy = 0. (2.6.2) 


Assume that the general solution of the corresponding homogeneous equation is known: 
y(t) = cy, (t)+c2y2(t). Our goal is to find the general solution of the nonhomogeneous 
equation. Suppose that we can find somehow a particular solution Y(t) of the nonho- 
mogeneous equation, so that 


Y" + p()Y’ +e(HY = f(t). (2.6.3) 
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From the equation (2.6.1) subtract the equation (2.6.3): 
QY-Y)" + pOW—- Y)' + sO - Y) = 0. 


We see that the function v = y — Y is a solution of the homogeneous equation (2.6.2), 
and then v(t) = c,y,(t) + c2y2(t), for some constants c; and cy. We express y = Y + v, 
giving 
yt) = YO) + yO + ey). 

In words: the general solution of the nonhomogeneous equation is equal to the sum of 
any particular solution of the nonhomogeneous equation and the general solution of the 
corresponding homogeneous equation. 

Finding a particular solution Y(t) is the subject of this section (and the following 
two sections). We now study the method of undetermined coefficients. 


Example 2.6.1. Find the general solution of 
y” + 9y = —4c0s 2t. 
The general solution of the corresponding homogeneous equation 
y"+9y =0 

is y(t) = c, cos3t + c, sin 3t. We look for a particular solution in the form Y(t) = 
Acos 2t. Substitute this in and then simplify: 

—4A cos 2t + 9A cos 2t = —4 cos 2t, 

5A cos 2t = —4 cos 2t, 


giving A = -* and Y(t) = -< cos 2t. 
Answer. y(t) = -* cos 2t + c, cos 3t + cy sin 3¢. 


This was an easy example, because the y’ term was missing. If the y’ term is 
present, we need to look for Y(t) in the form Y(t) = A cos 2t + Bsin 2t. 


Prescription 1. Ifthe right side of the equation has the form acos at +b sin at, 
with constants a, b, and a, then look for a particular solution in the form Y(t) = 
Acosat + Bsinat. More generally, if the right side of the equation has the form 
(at + b)cosat + (ct + d)sinat, involving linear polynomials, then look for a partic- 
ular solution in the form Y(t) = (At + B) cos at + (Ct+ D) sin at. Even more generally, 
if the polynomials are of higher power, we make the corresponding adjustments. 


Example 2.6.2. Solve y” — y’ — 2y = —4 cos 2t + 8 sin 2t. 
We look for a particular solution Y(t) in the form y(t) = Acos 2t + Bsin 2t. Sub- 
stitute y(t) into the equation and then combine the like terms: 


— 4A cos 2t — 4Bsin 2t — (—2A sin 2t + 2B cos 2t) — 2(Acos 2t + Bsin 2t) 
= —4cos 2t + 8 sin 2t, 


(—6A — 2B) cos 2t + (2A — 6B) sin 2t = —4 cos 2t + 8sin 2t. 
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Equating the corresponding coefficients, 
—6A — 2B = —4, 
2A — 6B = 8. 
Solving this system gives A = 1 and B = —1, so that Y(t) = cos 2t — sin 2t. The general 
solution of the corresponding homogeneous equation 
Ee ae al 


is y = ce + coe”. 
Answer. y(t) = cos 2t — sin2t + ce + c,e”’. 


Example 2.6.3. Solve y” + 2y’+y=t-1. 
On the right we see a linear polynomial. We look for particular solution in the 
form Y(t) = At + B. Substituting this in gives 
2A+At+B=t-1. 

Equating the corresponding coefficients, we get A = 1and2A+B = —1,sothat B = —3. 
Then, Y(t) = t — 3. The general solution of the corresponding homogeneous equation 
y"+2y'+y=0 
isy=cje'+c,te™. 


Answer. y(t)=t—3+ce7! +c,te~'. 


Example 2.6.4. Solve y" + y’ — 2y =t?. 

On the right we have a quadratic polynomial (two of its coefficients happened to be 
zero). We look for a particular solution as a quadratic Y(t) = At? + Bt+C. Substituting 
this in, gives 

2A + 2At+ B—2(At? + Bt+C) =??. 

Equating the coefficients in t?, t, and the constant terms gives 
2A =1, 
2A — 2B =0, 
2A+B-—2C=0. 


From the first equation, A = — =, from the second one, B = — 7 and from the third, C = 


A+ ~B = -*, so that Y(t) = <7 Seco The general solution of the corresponding 


homogeneous equation is y(t) = c,e~~! + cye’. 
yy ce —2t t 
Answer. y(t) = =e _ st TZ tee” + ce. 
The last two examples lead to the following prescription. 
Prescription 2. If the right-hand side of the equation (2.6.1) is a polynomial of degree 
n: Agt” + ayt"! + +++ + a,_1t + Gy, look for a particular solution as a polynomial of 


degree n: Agt” + A,t""! + --- +A,_jt + Ay, with the coefficients to be determined. 


And on to the final possibility. 


2.7. More on Guessing of Y(t) 75 


Prescription 3. If the right side of the equation is a polynomial of degree n, 
times an exponential : (aot” tat? }+--+a,_yt+ An) e“, look for a particular so- 
lution as a polynomial of degree n times the same exponential: (Aot” HAM Hoe $ 
Apy-it + A, )e** , with the coefficients to be determined. 
Example 2.6.5. Solve y” + y = te~”'. 

We look for a particular solution in the form Y(t) = (At+B)e~?“. Compute Y’(t) = 
Ae~*! — 2(At + B)e~?!, Y"(t) = —4Ae~*! + 4(At + B)e~?. Substitute Y(t) into the 
equation: 


4Ate~2! — 4Ae—2! + 4Be-*! + Ate?! + Be~2! = te~!, 


Divide by e~*! and then equate the coefficients in t and the constant terms 
5A = 1, 
—4A +5B=0, 


which gives A = 1/5 and B = 4/25, so that Y(t) = (<t + =e, 
Answer. y(t) = (ct + =e“ +c, cost +c, sint. 


Example 2.6.6. Solve y" — 4y = t? + 3e!, y(0) = 0, y'(0) = 2. 
One can find Y(t) as a sum of two pieces, Y(t) = Y,(t) + Y(t), where Y,(t) is any 
particular solution of 
y" = 4y — t2 
and Y,(t) is any particular solution of 
y" —4y = 3e’. 


(Indeed, adding the identities Y;’—4Y, = t* and Y;'—4Y, = 3e! gives Y" —4Y = t?+3e'.) 
Using our prescriptions, Y(t) = ul - =, and Y(t) = —e’. The general solution is 


y(t) = aris - ; —e!' +c, cosh 2t + c, sinh 2t. Calculate c, = 9/8 and c, = 3/2. 


Answer, y(t) = —2t? — + —et +2 cosh 2t + 2 sinh2z. 
4 8 8 2 


2.7 More on Guessing of Y(t) 


The prescriptions from the previous section do not always work. In this section we 
sketch a “fix”. A more general method for finding Y(t) will be developed in the next 
section. 


Example 2.7.1. Solve y” + y = sint. 
We try Y(t) = Asint + Bcost, according to Prescription [l. Substituting Y(t) into 
the equation gives 
0 =sint, 


which is impossible. Why did we “strike out”? Because A sin t and B cost are solutions 
of the corresponding homogeneous equation. Let us multiply the initial guess by t 
and try Y = Atsint + Btcost. Calculate Y’ = Asint + Atcost + Bcost — Btsint 
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and Y” = 2Acost — Atsint — 2Bsint — Btcost. Substitute Y into our equation, and 
simplify: 
2A cost —Atsint —2Bsint — Btcost+ Atsint + Btcost = sint, 
2A cost —2Bsint = sint. 


We conclude that A = 0 and B = —1/2, so that Y = —*tcos t. 


Answer. y= —<tcost +c, sint +c, cost. 


This example prompts us to change the strategy. We now begin by solving the corre- 
sponding homogeneous equation. The prescriptions from the previous section are now 
the Initial Guesses for the particular solution. We now describe the complete strategy, 
which is justified in the book of W. E. Boyce and R. C. DiPrima [Al]. 

If any of the functions appearing in the Initial Guess are a solution of the correspond- 
ing homogeneous equation, multiply the entire Initial Guess by t, and look at the new 
functions. If some of them are still solutions of the corresponding homogeneous equation, 
multiply the entire Initial Guess by t?. This is guaranteed to work. (Of course, if none of the 
functions appearing in the Initial Guess are a solution of the corresponding homogeneous 
equation, then the Initial Guess works.) 

In the preceding example, the Initial Guess involved the functions sin ¢ and cost, 
both solutions of the corresponding homogeneous equation. After we multiplied the 
Initial Guess by t, the new functions ft sint and t cost are not solutions of the corre- 
sponding homogeneous equation, and the new guess worked. 


Example 2.7.2. Solve y” + 4y’ = 2t —5. 
The fundamental set of the corresponding homogeneous equation 
y” +4y' =0 

consists of the functions y,(t) = 1 and y(t) = e~*'. The Initial Guess, according to 
Prescription B, Y(t) = At + B, is a linear combination of the functions t and 1, and the 
second of these functions is a solution of the corresponding homogeneous equation. 
We multiply the Initial Guess by t, obtaining Y(t) = t(At + B) = At? + Bt. This isa 
linear combination of t? and t, both of which are not solutions of the corresponding 
homogeneous equation. Substituting Y(t) into the equation gives 


2A + 4(2At + B) = 2t—5. 
Equating the coefficients in t and the constant terms, we have 
8A = 2, 
2A +4B=-—5, 


2 
giving A = 1/4 and B = —11/8. The particular solution is Y(t) = - = =t. 
2 
Answer. y(t) = - - 1 +¢,+c,e-*, 
Example 2.7.3. Solve y” + 2y’+y=te-'. 


The fundamental set of the corresponding homogeneous equation consists of the 
functions y,(t) = e~‘ and y,(t) = te‘. The Initial Guess, according to Prescription B,, 


2.8. The Method of Variation of Parameters 77 


(At + B)e? = Ate + Be‘, is a linear combination of the same two functions. We 
multiply the Initial Guess by t: t(At + B)e~' = At?e~' + Bte~'. The new guess is a 
linear combination of the functions t#e~' and te~‘. The first of these functions is not 
a solution of the corresponding homogeneous equation, but the second one is. There- 
fore, we multiply the Initial Guess by t?: Y = t?(At + B)e~' = At3e~! + Bt*e~*. It is 
convenient to write Y = (At? + Bt?)e~", and we substitute this in: 
(6At + 2B)e—* — 2(3At? + 2Bt)e! + (At? + Bt?)e~* 
+ 2[(3At? + 2Bt)e~' — (At? + Bt?)e'] + (At? + Bt?)e~! 
= te. 


Divide both sides by e~‘, and simplify: 


6At+2B=t. 
It follows that 
6A = 1, 
2B = 0, 


giving A = 1/6 and B= 0. 


3 


1 
Answer. y(t) = <Pe '4+coe'+ ete. 


2.8 The Method of Variation of Parameters 


We now present a more general way to find a particular solution of the nonhomoge- 
neous equation 


y" + py’ + Oy = FO. (2.8.1) 
Let us assume that y,(t) and y,(t) form a fundamental solution set for the correspond- 
ing homogeneous equation 
y" + pty’ + sy = 0 (2.8.2) 
(so that c,y,(t) + c2y2(t) gives the general solution of (2.8.2). We look for a particular 
solution of in the form 
Y(t) = u(y + ug(t)yr(), (2.8.3) 


with some functions u,(t) and u(t), that shall be chosen to satisfy the following two 
equations: 


uy (yi (t) + uz(Oya(d) = 0, 
u(y) + u(y) = FO. 


We have a system of two linear equations to find u}(t) and u4(t). Its determinant 


(2.8.4) 


wi) y(t) 
W(t) = U U 
O=|30 jo 
is the Wronskian of y,(t) and y,(t). By Theorem W(t) # 0 for all t, because y,(t) 
and y2(t) form a fundamental solution set. By Cramer’s rule (or by elimination), the 
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solution of is 
ui) = 
(2.8.5) 
ipa a. dt OVD) 
u(t) = wit)” 


The functions u,(t) and u2(t) are then computed by integration. We shall show that 
Y(t) = u,(t)y (t) + u2(t)y2(t) is a particular solution of the nonhomogeneous equa- 
tion (2.8.1). Let us compute the derivatives of Y(t), in order to substitute Y(t) into the 


equation (2.8.1). Obtain 
Y'(1) = yOu) + uO + mOn© + w(Oyo(t) = uOyi(O) + uOy2(). 


Here the first two terms have disappeared (they add up to zero), thanks to the first 


equation in (2.8.4). Next, 


Y"O)=MmOnO +wmOyO + uO + w(Oy2 
= fO+ MONO + mOy2O), 


by using the second equation in (2.8.4). Then 


Y" + pY’+gY = f(t) +uyyy + uyz + DCU, + U2y2) + BCU) + U2y2) 
= f(t)+ujO7 + py, + gyi) + Ua(yz + Py + By2) 
= f(), 


which proves that Y(t) is a particular solution of (2.8.1). (Both brackets are zero, be- 
cause y,(t) and y(t) are solutions of the corresponding homogeneous equation (2.8.2).) 
In practice, one begins by writing down the formulas (2.8.5). 
Example 2.8.1. Find the general solution of 
y"+y=tant. 
The fundamental set of the corresponding homogeneous equation 
y"+y=0 
consists of y, = sint and y, = cost. Their Wronskian 


sint cost 


W(t) = : 
© cost —sint 


“£9 
|= -sin t —cos*t = —1, 


and the formulas give 


u,(t) = tant cost = sint, 
sin’ t 
cost” 


u(t) = —tantsint = — 
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Integrating, u,(t) = — cos t. We set the constant of integration to zero, because we only 
need one particular solution. Integrating the second formula, 


sin’ t 
Uz(t) = -{ dt 


cost 


LH 2 
--| cos*t 
cos t 
= | (sect + cos ar 


= —In|sect + tant| + sint. 


We have a particular solution (Y = u,y, + uzy2) 


Y(t) = —costsint + (—In|sect + tant| + sint)cost = —costIn|sect + tant]. 
Answer. y(t) = —costIn|sect + tant| +c, sint + cz cost. 


Example 2.8.2. Let us revisit the equation 
y"+2y' +y= tet, 


for which we needed to use a modified prescription in the preceding section. The fun- 
damental set of the corresponding homogeneous equation 

y"+2y'+y=0 
consists of y, = e~' and y, = te~‘, and their Wronskian is W(),, y,)(t) = - —2t| Then 
by the formulas (2.8.5), ui, = —t?, giving u, = -, and u}, = t, giving uz = —. Obtain 
3,-t 


1 
Y= uy) + Uy, = -te 


3 t 


Answer. y(t) = =i et+ce'+c,te 


2.9 The Convolution Integral 


This section introduces the convolution integral, which allows a quick computation of 
a particular solution Y(t), in the case of constant coefficients. 


2.9.1 Differentiation of Integrals. If g(t, s) isa continuously differentiable func- 
tion of two variables, then the integral ie g(t, s) ds depends on a parameter ft (s is a 
dummy variable). This integral is differentiated as follows: 


a fe b 
ai } te, s)ds= [ g,(t, s) ds, 
a 


where g;(t, s) denotes the partial derivative in t. To differentiate the integral ie g(s) ds, 
one uses the fundamental theorem of calculus: 
t 


Gi | 8Ods= a0. 
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The integral Sf, g(t, s) ds depends on a parameter ¢, and it also has t as its upper limit. 
It is known from calculus that 


t t 
< [ g(t,s)ds = [ g,(t,s) ds + g(t, t), 
a a 


so that, in effect, we combine the previous two formulas. Now let z(t) and f(t) be some 
functions; then the last formula gives 


t t 
< at—syf)ds= [ 2¢-sf(6)ds+ 20)F00. (2.9.1) 


2.9.2 Yet Another Way to Compute a Particular Solution. We consider 
the nonhomogeneous equation 


y”" + py’ + gy = f(t), (2.9.2) 


where p and g are given numbers and f(t) is a given function. Let z(t) denote the 
solution of the corresponding homogeneous equation, satisfying 


Zz" +pz'+gz=0, 2z(0)=0, 2’(0)=1. (2.9.3) 


Then we can write a particular solution of (2.9.2) as a convolution integral 


t 
Y(t) = ii z(t — s) f(s) ds. (2.9.4) 
) 


To justify this formula, we compute the derivatives of Y(t), by using the formula (2.9.1) 
and the initial conditions z(0) = 0 and z’(0) = 1: 
t t 


Y'(t) = [ 2(t—s)f(s)ds + 0)f(0 = [ Z(t —sf(sdds, 
0 0 


t t 
Y"(t) = [ z(t —s)f(s)ds+z’(O)f() = i z(t —s)f(s)ds + f(t). 
0 0 


Then 
t 


Y"(t) + pY’O+sY() = [ [2"(t — s) + p2'(t — s) + gz(t —s)] f(s)ds+ f(t) =f. 


0 
Here the integral is zero, because z(t) satisfies the homogeneous equation in (2.9.3), 


with constant coefficients p and g, at all values of its argument f, including t — s. 
Example 2.9.1. Let us now revisit the equation 
y"+y=tant. 


Solving 
zZ"+z=0, z0)=0, z2’(O)=1 


gives z(t) = sint. Then 
t 
Y(t) = [ sin(t — s) tans ds. 
0 


Writing sin(t—s) = sin t cos s—cos t sin s and integrating, it is easy to obtain the solution 
we had before. 
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2.10 Applications of Second-Order Equations 


One of the main applications of differential equations is to model mechanical and elec- 
trical oscillations. This section is mostly devoted to oscillations of springs, like the 
springs used in our cars. 


2.10.1 Vibrating Spring. 


VN YN, 
0 y 0 y(t) v 
Spring at rest Extended spring 


Ifa spring is either extended or compressed, it will oscillate around its equilibrium 
position. We direct the y-axis along the spring, with the origin chosen at the equi- 
librium position. Let y = y(t) denote the displacement of a spring from its natural 
position at time f. Its motion is governed by Newton’s second law 


ma = f. 


The acceleration a = y’(t). We assume that the only force f, acting on the spring, is its 
own restoring force, which by Hooke’s law is f = —ky, for small displacements. Here 
the physical constant k > 0 describes the stiffness (or the hardness) of the spring. Then 


Divide both sides by the mass m of the spring, and denote k/m = w (so that @ = 
/k/m), obtaining 
y" +a7y =0. 
The general solution, y(t) = c, cos wt + c, sin wt, gives us the harmonic motion of the 
spring. 
To understand the solution better, let us write y(t) as 


c c 
y(t) = 4/ c? +3 | ——_~ cos wt + ——*— 
[ci + [ci +3 


Cy C2 ‘ 
= A(= coset =2 sin wt), 
A e A 


sin wt 


where we denoted A = ,/c? +c3. Observe that (SP + (Coy = 1, which means that 


we can find an angle 6, such that cos6 = ri and sind = re Then our solution takes 
the form 

y(t) = A (cos wt cos 6 + sinwt sind) = A cos(wt — 6). 
We conclude that any harmonic motion is just a shifted cosine curve of amplitude 
A = 4/c} +4 and of period The larger w is, the smaller is the period, and the 
oscillations are more frequent, so that w gives us the frequency of oscillations, called 
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the natural frequency of the spring. The constants c, and c, can be computed, once the 
initial displacement y(0) and the initial velocity y’(0) are prescribed. 


Example 2.10.1. Solving the initial value problem 
y"+4y=0, y0)=3, y')=-8, 


one gets y(t) = 3 cos 2t — 4sin 2t. This solution is a periodic function, with the ampli- 
tude 5, the frequency 2, and the period z. 
The equation 


y" +o*y = f(t) (2.10.1) 
models the case when an external force, with acceleration equal to f(t), is applied to 
the spring. Indeed, the corresponding equation of motion is now 

my" = —ky + mf(¢), 
from which we get (2.10.1), dividing by m. 
Let us consider the case of a periodic forcing term 


y" +o*y = asin vt, (2.10.2) 


where a > 0 is the amplitude of the external force and v is the forcing frequency. If 
v # w, we look for a particular solution of this nonhomogeneous equation in the form 
Y(t) = Asin vt. Substituting this in gives A = >—. The general solution of (2.10.2), 
which is y(t) = 


a 


= sin vt + c, cos wt + cz sin wt, is a superposition (sum) of the har- 
O*—V 


monic motion, and the response term ( 


5 Sin vt) to the external force. We see that 
O*+—V 
the solution is still bounded, although not periodic anymore, for general v and w, as a 
sum of functions of different periods 7 and = (such functions are called quasiperi- 

v {63} 


odic). 

A very important case is when v = w, so that the forcing frequency is the same 
as the natural frequency. Then a particular solution has the form Y(t) = Atsin vt + 
Btcosvt, so that solutions become unbounded, as time t increases. This is the case 
of resonance, when a bounded external force produces unbounded response. Large 
displacements will break the spring. Resonance is a serious engineering concern. 


Example 2.10.2. y” + 4y = sin 2t, y(O) = 0, y'(0) = 1. 

Both the natural and forcing frequencies are equal to 2. The fundamental set of 
the corresponding homogeneous equation consists of sin 2t and cos 2t. We search for 
a particular solution in the form Y(t) = At sin 2t + Bt cos 2t, corresponding to a mod- 
ified prescription (alternatively, one can use the variation of parameters method). As 
before, we compute Y(t) = — xt cos 2t. Then the general solution is y(t) = =< cos 2t + 


c, cos 2t + c, sin 2t. Using the initial conditions, calculate c} = 0 and c, = °, so that 
y(t) = -it cos 2t + ; sin 2t. The term -it cos 2t introduces oscillations, with the am- 


plitude zf increasing without bound, as time t > ov; see Figure 2.3} (It is customary to 
call such an unbounded term a secular term, which seems to imply that the harmonic 
terms are divine.) 
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y 


Figure 2.3. The graph of the secular term y = 
—=tcos 2t, oscillating between the lines y = =u 


and y= “t. 


2.10.2 Problems. 
I. Solve the following nonhomogeneous equations. 


1. 2y” — 3y’+y = 2sint. 
A a tis 8 1, 
nswer. y = cye'"” + ce! + cost — ~ sint. 


2. y” +4y’ + 5y = 2cos 2t — 3 sin 2t. 


2 2 


2 1. 
Answer. y = = cos2t + = sin 2t + cye~ ‘cost +c,e~* sin t. 
3. y” —y’ = 5sin2t. 

Answer. y = c; + ce! + = COS 2t — sin 2t. 


4. y” + 9y = 2cos vt, v # 3 is a constant. 


Answer. y= cos vt + c; COS 3t + cp sin 3¢. 


9-2 


5. y’ +2y’ +y = 2t cost. 


Hint. By Prescription fl, look for a particular solution in the form y = 
(At + B)cost + (Ct + D)sint. 


Answer. y = cost +(t—1)sint+c,e' +. cte. 
6. y"—2y +y=t4+2. 


Answer. y=t+4+4+ ce! + coe't. 
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10. 


11. 


12. 


13. 


14. 
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Jy +4y=t?-3t4+1. 


Answer. y = = (2t? — 6t + 1) +c, cos 2t + cy sin 2¢. 


1 
8 


ay sp Se8 


St 
e ad 
Answer. y = — + ce 3t + ce3!, 


. y” —4y = te*', y(0) = 0, y'(0) = 1. 


1 6 13 1 
Answer. y = (0 — <) er! — ~ eA 4 -92t 
5 25 50 2 
2y"+y -y=(5?4+t-Der. 
1 
Answer. y = ey (5t? + 15t + 16) + cye!/? + ene. 
4y” + 8y’ + 5y = 5t —sint. 
8 8 Ti od t _ t 
Answer. y=t—- + —cost— —sint+cje-‘cos- + ce‘ sin -. 
5 65 65 2 2 
y ty =2e% +07. 
2 At 1 42 : 
Answer. y = ae +t* —2+c, cost +c, sint. 
y” —y’ = 2sint — cos 2t. 
: 1 18, <4 
Answer. y = cost —sint + - cos 2t + Te sin2t+c, + ce°. 


For the first-order equation 


y' —x*y = 2x — x4 


x3 
the integrating factor 4 =e 3 leads to an intractable integral. Instead, look 
for a particular solution as a quadratic polynomial, and add to it the general 
solution of the corresponding homogeneous equation. 


3 
x: 
Answer. y= x* +ce3. 


II. Solve the nonhomogeneous equations (using the modified prescriptions). 


1. 


2. 


y” +y =2cost. 
Answer. y = tsint +c, cost +c) sint. 
y’ +y' -—6y =—e7!, 


1 2 
Answer. y = eet + cye*! + cre, 
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3. y"+2y' +y=2e%. 


Answer. y = te! + ce~! + cyte. 


4. y"—-2y +y=tel. 


Bet 
Answer. y= —— + ce’ + cote’. 


5. y" —4y' =2-cost. 


cost 4sint 


+ 
17 17 


t 
Answer. y = —> + + ce +c). 


6. 2y”—y' -y =3e!. 


1 
=2) 
Answer. y= te'+cje 2 +c. 


III. Write down the form in which one should look for a particular solution, but DO 
NOT compute the coefficients. 


1. y” + y = 2sin 2t — cos 3t — 5t7e*! + 4t. 

Answer. A cos 2t + B sin 2t + C cos 3t + D sin 3t + (Et? + Ft + G)e* + Ht +1. 
2. y’ +y = 4cost — cos 5t + 8. 

Answer. t(Acost + Bsint) + Ccos5t+ Dsin5t+ E. 
3. y" —4y’ + 4y = 3te* + sin 4t — t?. 

Answer. t* (At + B)e”! + Ccos4t + Dsin4t + Et? + Ft+G. 


IV. Find a particular solution, by using the method of variation of parameters, and 
then write down the general solution. 


1, y' +y' =6y = Se". 
Answer. y = te*" + cye7*! + c,e*". 


” ’ et 
2. y —2y 2 a eee 


Et 


Answer. y = cye! + cyte! — ~e! In(1 + t?) + te’ tan™ 
3. y’ +y=sint. 


Answer. y = -* cost +c, cost +c, sint. 
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10. 


11. 


12. 


13. 


.y’+2y¥+y=— 
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_y” +9y = —2e%", 


Hint. Similar integrals were considered in Section For this equation it is 
easier to use Prescription B| from Section 2.6, 
e 


t 
Answer. y = ard + c, cos 3t + c, sin 3¢. 


et 
= 
Answer. y = —te~' + te“ Int + ce"! + c,te*. 


e72t 


Jy" +4y' +4y = — 


12° 


Answer. y = —e~*! (1+ Int) + cje~*! + c,te~*. 


_ y" —4y = 8e, 


Answer. y = 2te*! + ce~*! + coe“. 


.y"+y=sect. 


Answer. y = c, cost + c, sint + costIn|cost|+¢sint. 


. y" + 3y’ = 6. 


Answer. y = t? — =t +cje7** +c. 
y" —y' -2y =e, (0) = 1, y'(0) = 0. 
Pot ys toot 
Answer. y = gc ce (3t — 5). 
y” + 4y = sin 2t, yO) = 0, y'(0) = 1. 
1 5. 
Answer. y = —7E cos 2t + ; sin 2t. 
2y" + 2y' —4y =e, 


Hint. Put this equation into the right form for the variation of parameters 


formula (2.8.5). 

1 
Answer. y = —=te"7! + ce~4 + cet. 
4y" + 4y'+ y =3tet. 


t t 
Answer. y = ~e! (3t-—4)+cje 2+cte 2. 
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V. Verify that the functions y, (t) and y,(t) form a fundamental solution set for the cor- 
responding homogeneous equation, and then use variation of parameters to find 
the general solution. 


1. fy” —2y=f-1, y(t) = #7, y(t) =0e7. 
Hint. Begin by putting this equation into the right form to use (2.8.5). 
Answer. y = - + <8 +¢,07 + cp. 

2. ty’ -(1+dy'+y=e*, y(t) =t+1, y(t) =e. 
Answer. y = ~e*(2t —1)+q(t+1)+ ce". 


3. x2y" +xy' + (2 - ~) y = x*/? (nonhomogeneous Bessel’s equation), 


y,(x) = x! cos x, y2(x) = x7? sin x. 


Answer. y = x14, cosx +c sin x). 


4* (303+ t)y” +2y' -6ty =4- 128, y(t) = *, y(t) = +1. 


Hint. Use Mathematica to compute the integrals. 
Answer. y = 2t + ce + c(t? +1). 
VI. 1. Use the convolution integral to solve 
y’ty=0, y0)=0, YOHL 
Answer. y = t? —2+2cost +sint. 


—s)n-1 
2. (i) Show that y(t) = ie — f()ds gives a solution of the nth-order 


equation 
y = FO. 


(This formula lets you compute n consecutive antiderivatives at once.) 
Hint. Use the formula (2.9.1). 


(ii) Solve the integral equation 
t 
y(t) + [ (t — s)y(s) ds = t. 
0 


Hint. Differentiate the equation twice, and also evaluate y(0) and y’(0). 
Answer. y = sint. 


3.* For the equation 
u" +(14 f)u=0 
assume that |f()| < ere with positive constants a and c, for t > 1. 


88 Chapter 2. Second-Order Equations 


(i) Show that all solutions are bounded as t > oo. 


2 


Hint. Consider the “energy” of the solution E(t) = =u + ~u. Then 


Ei = —f(Ouu! < |f(O|Iu'u| < |f(O| (ju? + 522) < ae. 


(ii) Show that this equation has two solutions such that for t > oo 
1 1 
u(1) = cost +0(=), u(t) = sint +0(=). 


(The “big 0” O (=) denotes any function whose absolute value is bounded 
by const ? 


as t > ©.) 


tx” 


Hint. Take f(t)u to the right-hand side, and treat it as a known function. 
Then for anyl<t<a 


u(t) = cost + : sin(t — s) f(s)u(s) ds 
t 


gives the unique solution of our equation, satisfying the initial condi- 
tions u(a) = cosa, u'(a) = — sina. This solution is written using an in- 
tegral involving itself. Since u(s) is bounded, | ££ sin(t—s)f(s)u(s) ds| < 
2 
4.* For the equation 
u"-(1+f())u=0 


assume that |f(t)| < a with positive constants a and c, fort > 1. Show 


that the equation has two solutions such that for t > oo 
1 1 
u,(t) = et (1+0(=)), u(t) =e! (1+0()). 
Hint. Expressing a solution as u(t) = e' + f sinh(t — s)f(s)u(s) ds, estimate 


t 
|u(t)| < et + se / e-S| f(s)||u(s)| ds. 
1 


Apply the Bellman-Gronwall’s lemma to show that z(t) = e~‘|u(t)| is bounded, 
and therefore |u(t)| < ce’. Then foranyl <t<a 


u(t) =e! — i sinh(t — s)f(s)u(s) ds, 
t 


and estimate the integral as above. (Similar questions are discussed in a nice 
old book by R. Bellman [2].) 


Lea) 
* 


In the equation 
y" +a*(x)y =0 
make a substitution y = b(x)u to obtain 


b? (bu) + (b"b3 + a*b*) u = 0. 
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6.* 


Te 


VI. 1. 


Select b(x) = re and then make a change of the independent variable x = f, 
atx 


d : 
so that — — =, ort = f a?(x) dx. Show that u = u(t) satisfies 
a 


1/1 
w+ (+145 (2) )u=o. 
a’ \a/xx 


This procedure is known as the Liouville transformation. It often happens that 


1/1 
~ (=) —> Oast > o. 
a3 aA/xx 


Apply the Liouville transformation to the equation 


y" +e%y =0. (2.10.3) 


1 
Hint. Here a(x) = e2*, t = e*, (-) = 1e-2x — +. Obtain 
a3 \a XX 4t2 
Conclude that the general solution of (2.10.3) satisfies 
3x 
y = ce~*/? cos(e*) + c,e~*/? sin(e*) + O (c 2 } as X > oo. 
Apply the Liouville transformation to the equation 


xy"-y=0. 
Conclude that the general solution satisfies 
1 1 1 
y= c,x4eV* + c,x4e-NX + 0 (x"#en), as X — oo. 
A spring has natural frequency w = 2. Its initial displacement is —1, and 


the initial velocity is 2. Find its displacement y(t) at any time t. What is the 
amplitude of the oscillations? 


Answer. y(t) = sin2t — cos2t, A = /2. 


. A spring of mass 2 lbs is hanging down from the ceiling, and its stiffness con- 


stant is k = 18. Initially, the spring is pushed up 3 inches and is given velocity 
of 2 inch/sec, directed downward. Find the displacement of the spring y(t) 
at any time t and the amplitude of oscillations. (Assume that the y-axis is 
directed down from the equilibrium position.) 


Answer. y(t) = : sin 3t — 3cos 3t, A = = 


. A spring has natural frequency w = 3. An outside force, with acceleration 


f(t) = 2cos vt, is applied to the spring. Here v is a constant, v # 3. Find the 
displacement of the spring y(t) at any time t. What happens to the amplitude 
of oscillations in case v is close to 3? 


2 : 
Answer. y(t) = 52 £08 vt + cy COS 3t + C2 sin 3t. 
=) 
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4. Assume that v = 3 in the preceding problem. Find the displacement of the 
spring y(t) at any time t. What happens to the spring in the long run? 


Answer. y(t) = <t sin 3t + c, cos 3t + c, sin 3t. 


5. Consider the dissipative (or damped) motion of a spring 
y” +ay’+9y =0. 


Write down the solution, assuming that a < 6. What is the smallest value of 
the dissipation constant a that will prevent the spring from oscillating? 


Answer. No oscillations for a > 6. 


6. Consider forced vibrations of a dissipative spring 
y” +ay’ + 9y = sin 3t. 
Write down the general solution for 
(i) a=0, 
(ii) a #0. 


What does dissipation do to the resonance? 


2.10.3 A Meteor Approaching the Earth. Let r = r(t) denote the distance 
of some meteor from the center of the Earth at time t. The motion of the meteor is 
governed by Newton’s law of gravitation 


‘i mMG 
mr" = — = (2.10.4) 
Here m is the mass of the meteor, M denotes the mass of the Earth, and G is the uni- 


versal gravitational constant. Let a be the radius of the Earth. If an object is sitting on 


Earth’s surface, then r = a and the acceleration r” = —g, the gravity of Earth, so that 
from 
_ MG 
g _ a2 


r’ =-g—. (2.10.5) 


We could solve this equation by letting r’ = u(r), because the independent variable t is 
missing. Instead, to obtain the solution in a more instructive way, let us multiply both 
sides of the equation by r’ and write the result as 


r'r” +g—r =0, 
d /{1_,2 ot 
= (3 -s<) Ms 
Ei a (2.10.6) 
2 SH” a 


2, 
so that the energy of the meteor, E(t) = =r*(t) - ere remains constant at all time. 
r 


(That is why the gravitational force field is called conservative.) We can now express 
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r'(t)=—-,/2c+ at and calculate the motion of meteor r(t) by separation of variables. 
ri 


However, as we are not riding on the meteor, this seems to be not worth the effort. What 
really concerns us is the velocity of impact, when the meteor hits the Earth, which is 
discussed next. 

Let us assume that the meteor “begins” its journey with zero velocity r’(0) = 0 and 
at a distance so large that we may assume r(0) = oo. Then the energy of the meteor at 
time t = 0 is zero, E(0) = 0. As the energy remains constant at all times, the energy at 
the time of impact is also zero. At the time of impact, we have r = a, and we denote 
the velocity of impact by v (r’ = v). Then from 

ie a? 
~v*(t) -g— =0 
xu) -—8— 
and the velocity of impact is 
2ga. 
Food for thought: The velocity of impact is the same as would have been achieved by 


free fall from height a. 
Let us now revisit the harmonic oscillations of a spring: 


y" +a*y =0. 
Similarly to the meteor case, multiply this equation by y’: 


ry sf 


yy" +w*yy’ =0, 
aay" + 57) =0 
E(t) = sy” + sey? = constant. 
With the energy E(t) being conserved, no wonder the motion of the spring was periodic. 


2.10.4 Damped Oscillations. We add an extra term to our model of spring mo- 
tion: 

my" =—ky—ky’, 
where k, is another positive constant. It represents an additional force, which is di- 
rected in the opposite direction, and is proportional to the velocity of motion y’. This 
can be either air resistance or friction. Denoting k,/m = a > Oandk/m = w, rewrite 
the equation as 


y" +ay'+o7y =0. (2.10.7) 
Let us see what effect the extra term cry’ has on the energy of the spring, E(t) = : y? + 
Ao y’. We differentiate the energy and express from the equation (2.10.7), y” = —ay’— 
wy, obtaining 


¥. y" ul ul x ul 72 
E'(t)=y'y" + w*yy' = y'(—ay' —w*y) + w*yy! = ay". 
It follows that E’(t) < 0, and the energy decreases. This is an example of a dissipative 
motion. We expect the amplitude of oscillations to decrease with time. We call a the 
dissipation (or damping) coefficient. 
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To solve the equation (2.10.7), write down its characteristic equation 
r+or+e* =0. 
—atV a2—4q2 


2 
There are three cases to consider. 


The roots are r = 


(i) a* —4w* < 0. (The dissipation coefficient « is small.) The roots are complex. If we 
denote a? — 4m? = -q’, with q > 0, the roots are = + if. The general solution 


a a 
y(t) = c,e 2‘ sin 4 +c e 2° cos ti 
exhibits damped oscillations (the amplitude of oscillations tends to zero, as t > 00). 
(ii) a? — 4m? = 0. There is a double real root = The general solution 
acy _% 
y(t) =cye 2 +cyte 2 
tends to zero as t > oo, without oscillating. 


(iii) a? — 4? > 0. The roots are real and distinct. If we denote q = V a2 — 42, then 


-a— —a+ . 
the roots are, = ; 4 and h= 4, Both roots are negative, because q < a. 


The general solution 
y(t) = eye"! + coe"! 


tends to zero as t > oo, without oscillating. We see that large enough dissipation 
coefficient a “kills” the oscillations. 


2.11 Further Applications 


This section begins with forced vibrations in the presence of damping. It turns out that 
any amount of damping “kills” the resonance, and the largest amplitude of oscillations 
occurs when the forcing frequency v is a little smaller than the natural frequency w. 
Then oscillations of a pendulum, and of two coupled pendulums, are studied. 


2.11.1 Forced and Damped Oscillations. It turns out that even a little damp- 
ing is enough to avoid resonance. Consider the equation 


y" +ay'+o’*y =sinvt (2.11.1) 


modeling forced vibrations of a spring in the presence of damping. Our theory tells 
us to look for a particular solution in the form Y(t) = A, cos vt + A, sinvt. Once the 
constants A, and A, are determined, we can use trigonometric identities to put this 
solution into the form 


Y(t) = Asin(vt — y), (2.11.2) 


with the constants A > 0 and y depending on A, and Aj. So, let us look for a partic- 
ular solution directly in the form (2.11.2). We transform the forcing term as a linear 
combination of sin(vt — y) and cos(vt — 7): 


sin vt = sin((vt —y) + y) = sin(vt — y) cosy + cos(vt — y) siny. 


2.11. Further Applications 93 


Substitute Y(t) = A sin(vt — y) into the equation (2.11.1): 
— Av’ sin(vt — y) + Aav cos(vt — vy) + Aw” sin(vt — y) 
= sin(vt — y) cosy + cos(vt — y) siny. 
Equating the coefficients in sin(vt — y) and cos(vt — y) gives 
vere ee 
ae ees ens 

Squaring both of these equations and adding the results, 

Ao —- PY +A ay? = 1, 


allows us to calculate A: 
1 


V@— vr)? + ev? 
To calculate y, divide the second equation in by the first 


av -1 
we — pe’ or Y = tan 


A= 


tany = 


w2 —_ y2 : 
We computed a particular solution 
1 -1 
Y(t) = ———— sin(vt —- y),_ where y = tan : 
© of (@? — v2)2 + oy? ( ”) : w2 — y2 


We now make a physically reasonable assumption that the damping coefficient a 
is small, so that a2 — 4w? < 0. Then the characteristic equation for the homogeneous 


equation corresponding to (2.11.1), 


r+ar+o? =0, 


2— G2 
has a pair of complex roots =] + i8, where 8 = “= The general solution of 
(2.11.1) is then 
—<t ue 1 ; 
y(t) =cye 2 cos Bt + c2e 2 sin Bt + ———- sin(vt = y). 


(w2 — v2)2 + ay? 
The first two terms of this solution are called the transient oscillations, because they 
quickly tend to zero, as time t goes on (“sic transit gloria mundi”), so that the third 
term, Y(t), describes the oscillations in the long run. We see that oscillations of Y(t) 
are bounded, no matter what the frequency v of the forcing term is. The resonance is 
gone! Moreover, the largest amplitude of Y(t) occurs not at v = a, but at a slightly 
smaller value of v. Indeed, the maximal amplitude happens when the quantity in the 
denominator, (w? — v?)? + ay’, is the smallest. This quantity is a quadratic in v’. Its 
2 a2 


ini hen v? =@2 —-= = ote 
minimum occurs when v* = w° — —, ory = \/o?— —. 


2.11.2 An Example of a Discontinuous Forcing Term. We now consider 
equations with a jumping force function. A simple function with a jump at some num- 
ber c is the Heaviside step function 


0 ift<c, 
1 ift>c. 


u(t) = | 
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Example 2.11.1. For t > 0, solve the problem 


y" +4y =f, 
y(0) =0, y'(0) =3, 
where 
0 ift < 7/4, 
t+1 ift>/4. 


ro} 


Physical interpretation: No external force is applied to the spring before the time t = 
z/4, and the force is equal to t + 1 afterwards. The forcing function can be written as 


FO = Una OE + DV. 
The problem naturally breaks down into two parts. When 0 < t < 7/4, we are 
solving 


y"+4y=0. 
Its general solution is y(t) = c, cos 2t + cz sin 2t. Using the initial conditions, calculate 
Cc) = 0,c2 = *, so that 
y(t) = 5 sin 2t, fort < 7/4. (2.11.4) 
At later times, when t > 77/4, our equation is 
y+ 4yat+1. (2.11.5) 


But what are the new initial conditions at the time t = 77/4? Clearly, we can get them 
from @IL4): 
3 
VAS) Se Ye) =, (2.11.6) 


: F 1 ; : 
The general solution of (2.11.5) is y(t) = “t+ ri +c, cos 2t+c, sin 2t. Calculating c, and 
Pere a3 : . 1,,1,1 5 ny. 
2 =Hfpoee 2 ge ; 
Cc, from the initial conditions in gives y(t) git Zt; c0s2t t+ C Ta sin 2t 


Answer. 
= sin 2t, if t < 7/4, 
y(t) = 44 
4 
Observe that the solution y(t) is continuous at t = 77/4. 


t+ i + * cos2t+(2 - *) sin 2t, ift > 7/4. 
4 8 4 16 


2.11.3 Oscillations of a Pendulum. Assume that a small ball of mass m is at- 
tached to one end of a rigid rod of length 1, while the other end of the rod is attached 
to the ceiling. Assume also that the mass of the rod itself is so small that it can be ne- 
glected. Clearly, the ball will move on an arc of a circle of radius 1. Let 6 = @(t) be the 
angle that the pendulum makes with the vertical line, at the time t. We assume that 
8 > Oif the pendulum is to the left of the vertical line, and 6 < 0 to the right of the ver- 
tical. If the pendulum moves by an angle of 6 radians, it covers the distance 16 = 10(t). 
It follows that 16’(t) gives its velocity, and 16”(t) the acceleration. We assume that the 
only force acting on the mass is the force of gravity. Only the projection of this force 
on the tangent line to the circle is active, which is mg cos(# — 8) = mgsin 9. Newton’s 
second law of motion gives 


ml" (t) = —mg sin 8 
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& 


Gravity acting on a pendulum, ¢ = - — 0. 


(minus because the force works to decrease the angle 9, when @ > 0, and to increase 
6, if 6 < 0). Denoting g/l = w”, we obtain the pendulum equation 


6” (t) + w sin 6(t) = 0. 


If the oscillation angle @(t) is small, then sin 6(t) = @(t), giving us again a harmonic 
oscillator 


6" (t) + w*A(t) = 0, 


this time as a model of small oscillations of a pendulum. 


2.11.4 Sympathetic Oscillations. Suppose that we have two pendulums hang- 
ing from the ceiling and they are coupled (connected) through a weightless spring. Let 
x, denote the angle the left pendulum makes with the vertical line. We consider this 
angle to be positive if the pendulum is to the left of the vertical line, and x, < O if the 
pendulum is to the right of the vertical line. Let x, be the angle the right pendulum 
makes with the vertical, with the same assumptions on its sign. We assume that x, 
and xz are small in absolute value, which means that each pendulum separately can 
be modeled by a harmonic oscillator. 
For the coupled pendulums the model is 
x] +.w?x, = —k(x — x2), 
Faces (2.11.7) 
x5 + 07x, = k(x, — X2), 
where k > 0 is a physical constant, describing the stiffness of the coupling spring. 
Indeed, if x; > x2 > 0, then the coupling spring is extended, so that the spring tries 
to contract, and in doing so it pulls back the left pendulum, while pulling forward 
(accelerating) the right pendulum. (Correspondingly, the forcing term is negative in 
the first equation and positive in the second one.) In case 0 < x, < X, the spring is 
compressed, and as it tries to expand, it accelerates the first (left) pendulum and slows 
down the second (right) pendulum. We shall solve the system (2.11.7), together with 
the simple initial conditions 


x,(0)=a, x,(0)=0, x,(0)=0, x5(0)=0, (2.11.8) 


which correspond to the first pendulum beginning with a small displacement angle a 
and zero initial velocity, while the second pendulum is at rest. 
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Z} 


Two pendulums connected by a weightless spring. 


Add the equations in (2.11.7), and call z, = x; + x2. Obtain 
Zi +e@*z,=0, z,(0)=a, 2,(0)=0. 


The solution of this initial value problem is z,(t) = acoswt. Subtracting the second 
equation in (2.11.7) from the first one and calling z, = x, —x gives 23 +@7z, = —2kz), 
or 


2, +(w* +2k)z,=0, 2,(0)=a, 25(0)=0. 


Denoting w? +2k = wi, or @, = Vw? + 2k, we have z,(t) = acos@yt. Clearly, z; +z, = 
2x,. Then 


Z,+2Z acos wt + ACOs wf Te) @, +o 
x= a = ———j{ = acos 5100s = (2.11.9) 
using a trigonometric identity on the last step. Similarly, 
Z—Z acos wt — acos wt . O-O, , W+o 
Xz = a = = = asin tsin 3h (2.11.10) 


We now analyze the solution, given by the formulas and (2.11.10). If k is 


small (the coupling is weak), then w, is close to w, and so their difference w, — w is 
small. It follows that both cos “—t and sin “1 change very slowly with time f. 
Rewrite the solution as 


w, +a 
2 


w, +a 


t and x,=Bsin 5 


X, =Acos t, 


where we regard A = acos rm and B = asin 1 as slowly varying amplitudes. 
We interpret this by saying that the pendulums oscillate with the frequency are and 


with slowly varying amplitudes A and B. (The amplitudes A and B are also periodic. 

Oscillations with periodically varying amplitudes are known as beats; see Figure 2.4)) 
At times t, when cos —t is zero and the first pendulum is at rest (x, = 0), the am- 

1—-W 


plitude of the second pendulum satisfies | sin t| = 1, obtaining its largest possible 
absolute value. There is a complete exchange of energy: when one of the pendulums 
is doing the maximal work, the other one is resting. We see “sympathy” between the 
pendulums. Observe also that A? + B? = a’. This means that the point (x,(t), x2(t)) 


lies on the circle of radius a in the (x1, x2)-plane, for all t. 
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Figure 2.4. Oscillations of coupled pendulums: 
beats. 


Example 2.11.2. Using Mathematica, we solved a particular case of (2.11.7): 


xf +x, = —0.1(x; — x2), 
x5 +X = 0.1(x1 — x2), 
x, (0) = 2, 
x; (0) = 0, 
x2(0) = x4(0) = 0. 
The graphs of x,(t) and x(t) in Figure 2.4] both exhibit beats. Observe that max- 


imal amplitude of each of these functions occurs at times when the amplitude of the 
other function is zero. 


2.12 Oscillations of a Spring Subject to a Peri- 
odic Force 
This section develops the Fourier series, one of the most important concepts of math- 


ematics. Application is made to periodic vibrations of a spring. 


2.12.1 The Fourier Series. For vectors in three dimensions, one of the central 
notions is that of the scalar product (also known as the “inner product”, or the “dot 
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xy V1 
product”). Namely, ifx =| x, |andy=]| y, |], then their scalar product is 
X3 3 


(X,Y) = XY + X2y2 + X33. 


Scalar product can be used to compute the length of a vector ||x|| = (x, x) and the 
angle 6 between the vectors x and y 


(x, y) 


© [belly ll’ 


In particular, the vectors x and y are orthogonal (perpendicular) if (x,y) = 0. Ifi, j, 
and k are the unit coordinate vectors, then (x,i) = x,, (x,j) = x2 and (x,k) = x3. 
Writing x = x,i+ x2j + x3k, we express 


x=(x%,Di+ (% pjt+(% Ak. (2.12.1) 


This formula gives probably the simplest example of the Fourier series. 

We shall now consider functions f(t) that are periodic, with period 27. Such func- 
tions are determined by their values on any interval of length 27. So let us consider 
them on the interval (—7, 7). Given two functions f(t) and g(t), we define their scalar 
product as 


(f.g) = i F(®)g(t) de. 


We call the functions orthogonal if (f, g) = 0. For example, 


1s 


(sin t, cos t) = | sint cost dt = 0, 
-7 


so that sin t and cost are orthogonal. (Observe that the orthogonality of these functions 
has nothing to do with the angle at which their graphs intersect.) The notion of scalar 
product allows us to define the norm of a function 


l= Vn=\ [ " ppt. 
For example, 
|| sin tl] = 1 [swt ea = \ f(b deos a= Vz. 


Similarly, for any positive integer n, || sin nt|| = /7, || cos nt|| = V7, and ||1|| = y 27. 
We now consider an infinite set of functions 


1, cost, cos 2t,...,cosnt,...,sint, sin 2t,...,sinnt,.... 
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They are all mutually orthogonal. This is because 


a 


(1, cos nt) = [ cos nt dt = 0, 
—1 


a 


(1, sinnt) = [ sin nt dt = 0, 
-—7T 


7 
(cos nt, cos mt) = | cosntcosmtdt=0, foralln 4m, 
-7 
7 
(sin nt, sin mt) = i sinntsinmtdt=0, foralln4~m, 
-7 
7 
(sin nt, cos mt) = J sinntcosmtdt =0, foranynandm. 
-7 


The last three integrals are computed by using trigonometric identities. If we divide 
these functions by their norms, we shall obtain an orthonormal set of functions 


1 cost cos2t cos nt sint sin 2t sin nt 


which is similar to the coordinate vectors i, j, and k. It is known that these functions 
form a complete set, so that “any” function f(t) can be represented as their linear com- 
bination. Similarly to the formula for vectors (2.12.1]), we decompose an arbitrary func- 
tion f(t) as 


1 = cos nt sin nt 
FO = 49 + D(a Va +6), 


where 


1 tx” 
A = (ro. =) = Tm [ roa. 


Ay, = (ro. =n) = a [ s@cosnear, 


Bn = (r0 a) - a [ f(O)sinnedt. 
1 I Jen 


It is customary to denote dg = a/V27, a, = a, /V7, and b, = BnlV x, so that the 
Fourier series takes the final form 


f(t) = a9 + >) (ay cosnt + by sinnt), 


n=1 


with the coefficients given by 


a = [ fat, 


1 7 
ay, = al f@cos nt dt, 
=7E- 


1 7 
b, = =| f@sinnt dt. 
—T 
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The Pythagorean theorem takes the form 
IFIP = a5 + >) (n+ Br): 
n=1 
or 
1 7 oe) 
al f?(x) dx = 2a + >) (aa + bi), 
1 n=1 
which is known as Parseval’s identity. 
Example 2.12.1. Let f(t) be a function of period 27, which is equal to t + z on the in- 


terval (—7, 7). This is the sawtooth function. It is not defined at the points nz and —nz, 
with n odd, but this does not affect the integrals that we need to compute. Compute 


awe ers “(+ n)|" =7 
aa ae ~ Aq x 


Integrating by parts (or using guess-and-check), 


sinnt cos ua [" 
nz \l_z 


i he 1 
An = = [« +7) cosnt dt = eG +7) 
because sin nz = 0 and cosine is an even function. Similarly 
1 is 
by = =| (t + 2) sin nt dt 
—7 


1 cos nt sin nt] |* 
=[Jev 8) 
7 n —1 


n27 


2 
= —— COSn7 
n 
2 
= ——(-])" 
=(-1) 
2 
= =(-1 n+l 
—(—1) 


(Observe that cos nz is equal to 1 for even n and to —1 for odd n, which may be com- 
bined as cos nz = (—1)”.) The Fourier series for the function f(t) is then 


f=7a+ , *(-1y sin nt, 


n=1 
y 
A 
LA. LL. t 
—37 —7 1 370 57 71 


The saw-tooth function. 
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which is valid on (—oo, co) (with the exception of points nz and —nz, with n odd). 
Restricting to the interval (—7, 77) gives 


t+r= nese 2 (_1)"+1 sin nt, for -27 <t<z. 


n= Ne 


It might look like we did not accomplish much by expressing a simple function 
t +2 through an infinite series. However, one can now express solutions of differential 
equations through Fourier series. 


2.12.2 Vibrations of a Spring Subject to a Periodic Force. Consider the 
model 


y" +o*y = f(t), 


where y = y(t) is the displacement of a spring, w > 0 is a constant (the natural 
frequency), and f(t) is a given function of period 27, the acceleration of an external 
force. This equation also models oscillations in electrical circuits. Expressing f(t) by 
its Fourier series, rewrite this model as 


co 
y" +0*y =a) t+ b? (a, cos nt + b, sinnt). 


n=1 


Let us assume that w # n, for any integer n (to avoid resonance). According to our 
theory, we look for a particular solution in the form 


foe) 
Y(t) = Ap + >) (An cosnt + B, sinnt). 


n=1 
Substituting this in, we find 
a = bn 
rnd) F 
Y(t) = oe +> [Ss 5 cos nt + are) sin nt) . 
n=1 

The general solution is then 
(‘j= #+> (5 8 cosnt + sinnt +c, coswt + c, sin wt 
y mre) 2 _ n2 1 2 : 


We see that the coefficients in the mth harmonics (in cos mt and sin mt) are large, pro- 
vided that the natural frequency w is selected to be close to m. That is basically what 
happens when one is turning the tuning knob of a radio set. (The knob controls w, 
while your favorite station broadcasts at a frequency m, so that its signal has the form 
f() = ay, cos mt + b,, sin mt.) 


2.13 Euler’s Equation 


This section covers an important class of equations with variable coefficients. The un- 
derstanding of Euler’s equations will play a crucial role when infinite series are used 
in Chapter B] to solve differential equations. 
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Preliminaries. What is the meaning of 3V22 Or, more generally, what is the definition 
of the function t", where r is any real number? Here it is: t’ = elnt” — erlnt. We see 
that the function t” is defined only for t > 0. The function |¢|" is defined for all t 4 0, 
but what is the derivative of this function? 

More generally, if f(t) is a differentiable function, the function f(|t|) is differen- 
tiable for all t 4 0 (|t| is not differentiable at t = 0). Let us define the following step 
function: 

1 ift>0, 
a tt ift <0. 


Observe that 
ein = sign(t), for allt 40, 


as follows by considering separately the cases t > 0 and t < 0. 
The chain rule gives 


£ file! = f’(\t\))sign@), forallt £0. (2.13.1) 


In particular, <\e\" = r|t|/—! sign(t), for all t # 0. Also 


—In|t| = = 4 for all t # 0. (2.13.2) 


The Important Class of Equations. Euler’s equation has the form (here y = y(t)) 
at?y” + bty’ +cy =0, (2.13.3) 


where a, b, and c are given numbers. Assume first that t > 0. We look for a solution in 
the form y = ¢’, with the constant r to be determined. Substituting this in gives 


at?r(r — 1)t"-? + btrt’-! + ct” = 0. 
Dividing by a positive quantity ¢”, 
ar(r—1)+br+c=0 (2.13.4) 


gives us a quadratic equation, called the characteristic equation. There are three possi- 
bilities with respect to its roots, which we consider next. 


Case 1. There are two real and distinct roots 4 4 %. Then t” and t’? are two solutions, 
which are not constant multiples of each other, and the general solution (valid for t > 0) 
is 
y(t) = cyt"! + cot". 

If 7 is either an integer or a fraction with an odd denominator, then t” is also defined 
for t < 0. If the same is true for 7, then the above general solution is valid for all t # 0. 
For other 7, and n, this solution is not even defined for t < 0. 

We claim that y(t) = |t|"! gives a solution of Euler’s equation, which is valid for 
all t # 0. Indeed, calculate y’(t) = 4|t|"'—! sign(t), y’(t) = n(m — Dt"? (sign(t))” - 
(mh — 1)|t|"~2, and then substituting y(t) into Euler’s equation gives 


at? (nm — 1)|t\"~? + btn |t/"~? sign(t) + clt|" = |t\" (any — 1) + bA +) = 0, 
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because ¢ sign(t) = |t| and 7, is a root of the characteristic equation. It follows that 
y(t) = cy |t|" + colt" 


gives a general solution valid for all t # 0. 


Example 2.13.1. Solve 2t7y” + ty’ — 3y =0. 
The characteristic equation 


ar(y —1)+r—3=0 
3 
has roots, = —landn = =. The general solution y(t) = c,t~! + ct? is valid only for 


3 
t > 0, while y(t) = c,|t|~* + cy|t|2 is valid for t # 0. 


Example 2.13.2. Solve t*y” + 2ty’ — 2y =0. 
The characteristic equation 


rr—1)+2r—2=0 


has roots 7 = —2 andr = 1. The general solution y(t) = c,t~? + cyt is valid not 
just for t > 0, but for allt #4 0. Another general solution valid for allt #4 O is y(t) = 
¢|t|~? +c9|t| = cyt~? +c)|t|. This is a truly different function! Why such an unexpected 
complexity? If one divides this equation by t?, then the functions p(t) = 2/t and g(t) = 
—2/t* from our general theory are both discontinuous at t = 0. We have a singularity 
at t = O, and, in general, the solution y(t) is not even defined at t = 0 (as we see in 
this example), and that is the reason for the complexity. However, when solving initial 
value problems, it does not matter which form of the general solution one uses. For 
example, if we prescribe some initial conditions at t = —1, then both forms of the 
general solution can be continued only on the interval (—oo, 0), and on that interval 
both forms are equivalent. 

We now turn to the cases of equal roots and complex roots for the characteristic 
equation. One could proceed similarly to the linear equations with constant coeffi- 
cients. Instead, to understand what lies behind the nice properties of Euler’s equation, 
we make a change of independent variables from t to a new variable s, by letting t = e*, 
or s = Int. By the chain rule 


dy _dyds_dy1 
dt dsdt dst’ 
Using the product rule and then the chain rule, 
oF 8 (St ot oe 
dt2  dt\ds/t dst? ds2dtt dst? ds? t2 dst?’ 
Then Euler’s equation (2.13.3}) becomes 


This is a linear equations with constant coefficients! It can be solved for any a, b, and c. 
Let us use primes again to denote the derivatives in s in this equation. Then it becomes 


ay” +(b—a)y'+cy =0. (2.13.5) 
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Its characteristic equation 
ar? +(b—a)r+c=0 (2.13.6) 


is exactly the same as (2.13.4). 


We now return to Euler’s equation and its characteristic equation (2.13.4). 


Case 2. 7, is a double root of the characteristic equation (2.13.4); i.e., 7 isa double root 
of (2.13.4). Then y = c,e"5 + c,se”15 is the general solution of (2.13.5). Returning to 
the original variable t, by substituting s = Int and simplifying (using that e”!!™* = t"), 
obtain 
y(t) = ¢c,t! +¢e,t Int. 

This general solution of Euler’s equation is valid for t > 0. More generally, it is straight- 
forward to verify that 

y(t) = ey|\" + call" In |e] 
gives us the general solution of Euler’s equation, valid for all t # 0. 
Case 3. p + iq are complex roots of the characteristic equation (2.13.4). Then y = 


c,eP§ cos qs + c2seP§ sin qs is the general solution of (2.13.5). Returning to the original 
variable t, by substituting s = In t, we get the general solution of Euler’s equation 


y(t) = c,t? cos(qIn t) + ct? sin(q Int), 


valid for t > 0. One verifies that replacing t by |t| gives the general solution of Euler’s 
equation, valid for all t 4 0: 


y(t) = c,|t|P cos(q In |t|) + c2|t|? sin(q In |t\). 
Example 2.13.3. Solve t?y” — 3ty’+4y =0,t>0. 
The characteristic equation 
rr—1)-3r+4=0 
has a double root r = 2. The general solution is y = c,t? + cyt? Int. 
Example 2.13.4. Solve t7y" — 3ty’ + 4y =0, y(1) =4, y’(1) =7. 


Using the general solution from the preceding example, calculate c} = 4 and c, = 
—1. 


Answer. y = 4t? — t? Int. 
Example 2.13.5. Solve t*y" + ty’ +4y =0, y(-1) =0, y(-1) = 3. 
The characteristic equation 
rry—1)+r+4=0 


has a pair of complex roots +2i. Here p = 0, q = 2, and the general solution, valid for 
both positive and negative t, is 


y(t) = c, cos(2 In |t]) + cz sin(2 In |¢}). 


From the first initial condition, y(—1) = c, = 0, so that y(t) = cp sin(2 In |t|). Using the 
chain rule and the formula (2.13.2) 


y'(®) = ep.cos(2In |t))=, 


and then y’(—1) = —2c, = 3, giving c, = —3/2. 
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Answer. y(t) = -; sin(2 In |t}). 


Example 2.13.6. Solve ty" — 3ty’ +4y =t—2,t>0. 
This is a nonhomogeneous equation. Look for a particular solution in the form 
Y = At + B, and obtain Y = t — =. The fundamental solution set of the corresponding 


homogeneous equation is given by t? and t? Int, as we saw in Example above. 
The general solution is y = t — ; +c,t? +c,t?7 Int. 


2.14 Linear Equations of Order Higher Than Two 


Differential equations of order higher than two occur frequently in applications, for 
example when modeling vibrations of a beam. 


2.14.1 The Polar Form of Complex Numbers. For a complex number x + iy, 
one can use the point (x, y) to represent it. This turns the usual plane into the complex 
plane. The point (x, y) can also be identified by its polar coordinates (r, 0). We shall 
always take r > 0. Then 


z=x+iy=rcos@+irsin@ =r(cos@ + isin @) 


gives us the polar form of acomplex number z. Using Euler’s formula, we can also write 


z = re®. For example, —2i = ae because the point (0, —2) has polar coordinates 
(2, =). Similarly, 1 +i = V2els, and —1 = e’” (real numbers are just particular cases 
of complex ones). 

There are infinitely many ways to represent a complex number using polar coordi- 
nates z = re(+27™) where m is any integer (positive or negative). Let n be a positive 
integer. We now compute the nth root(s) of z: 

.,@ | 2mm 

gin — punt), = m=0,1,..,.n—1. (2.14.1) 
Here r!/” is the positive nth root of the positive number r (the “high school” nth root). 
Clearly, (a¥ ny" = z. When m varies from 0 to n — 1, we get different values, and then 
the roots repeat themselves. There are n complex nth roots of any complex number 
(and in particular, of any real number). All of these roots lie on a circle of radius r!/” 
around the origin, and the difference in the polar angles between any two neighbors is 
2m/n. 


The four complex fourth roots of —16, on the circle 
of radius 2. 
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Example 2.14.1. Solve the equation z* + 16 = 0. 
We need the four complex roots of —16 = 16e7+2""™, The formula (2.14.1) gives 


77 7m 
(—16)0/4) = 2e3*2?, =m =0,1,2,3. 


50. .370 
When m = 0, the root is 2e’4 = 2(cos + isin *) — 2 + iV2. The other roots, 2e’¢ , 
. 57 . 77 


2e' 4, and 2e' 4 , are computed similarly. They come in two complex conjugate pairs: 
V2 +ivy2and -/2 ss i2. In the complex plane, they all lie on the circle of radius 2, 
and the difference in the polar angles between any two neighbors is 77/2. 


Example 2.14.2. Solve the equation r? + 8 = 0. 

We need the three complex cube roots of —8. One of them ism = —2 = 2e!7 | and 
the other two lie on the circle of radius 2, at an angle 277/3 away, so that m = 2e!7/3 = 
1+ V3i and n = 2e~'7/3 = 1 — V3i. (Alternatively, the root r = —2 is easy to guess. 
Then factor r? + 8 = (r + 2)(r? — 2r + 4), and set the second factor to zero to find the 
other two roots.) 


2.14.2 Linear Homogeneous Equations. Let us consider fourth-order equa- 
tions 

apy” + ayy” + any” + a3y’ + ayy = 0, (2.14.2) 
with given numbers dg, a1, a2, a3, and a4. Again, we search for a solution in the form 
y(t) = e’', with a constant r to be determined. Substituting this in and dividing by the 


positive exponent e”', we obtain the characteristic equation 


m 


dor* + ayr? + apr? + azr +a, =0. (2.14.3) 
If one has an equation of order n 

agy™ + ayy") +--+ + dniy + any = 0, (2.14.4) 

with constant coefficients, then the corresponding characteristic equation is 
dor” + ayr™ 1 + ++) +a,_yr +a, = 0. (2.14.5) 
The fundamental theorem of algebra says that any polynomial of degree n has n roots 
in the complex plane, counted according to their multiplicity (a double root is counted 

as two roots, and so on). The characteristic equation has four roots. 

The theory is similar to the second-order case. We need four different solutions of 
(2.14.2), so that every solution is not a linear combination of the other three (for the equa- 
tion we need n different solutions). Every root of the characteristic equation 
must “pull its weight”. If the root is simple, it brings in one solution, if it is repeated 


twice, then two solutions (three solutions, if the root is repeated three times, and so 
on). The following cases may occur for the nth-order equation (2.14.4). 


Case 1. 7, isa simple real root. Then it brings e"’ into the fundamental set. 


Case 2. m, is a real root repeated s times. Then it brings the following s solutions into 
the fundamental set: e”1, te”!", ..., tS~ te"! 


Case 3. p + ig and p — iq are simple complex roots. They contribute e?* cos qt and 
e?' sin gt into the fundamental set. 


2.14. Linear Equations of Order Higher Than Two 107 


Case 4. p + iq and p — iq are repeated s times each. They bring the following 2s so- 
lutions into the fundamental set: e?‘ cos qt and e?! sin qt, te?‘ cos qt and te” sin qt,..., 
tS—leP* cos qt and te” sin qt. 


Cases 1 and 3 are justified as for the second-order equations. The other two cases 
are discussed in the Problems. 


mn 


Example 2.14.3. Solve y” — y =0. 
The characteristic equation is 


r4-1=0. 
We solve it by factoring 
(r-1(r +1)? +1) =0. 
The roots are —1, 1, —i, i. The general solution is y(t) = cye~! +.c,e' +c cost +cy sint. 


Example 2.14.4. Solve y” — 3y” + 3y’ —y =0. 
The characteristic equation is 


Pe —3r2+3r—1=0. 


This is a cubic equation. You probably did not study how to solve it by Cardano’s for- 
mula. Fortunately, you must remember that the quantity on the left is an exact cube: 


(r—1)? =0. 
The root r = 1 is repeated 3 times. The general solution is y(t) = c,e' + cyte’ + c3 ter. 
Let us suppose that you did not know the formula for the cube of a difference. 
Then one can guess that r = 1 is a root. This means that the cubic polynomial can be 


factored, with one factor being r — 1. The other factor is then found by long division. 
The other factor is a quadratic polynomial, and its roots are easy to find. 


Example 2.14.5. Solve y” — y” + 3y’+ 5y =0. 
The characteristic equation is 
rP—r+3r+5=0. 
We need to guess a root. The procedure for guessing a root (for textbook examples) is 
a simple one: try r = 0, r = +1, r = +2, and then give up. One sees that r = —lisa 
root, 4, = —1. It follows that the first factor is r + 1, and the second factor is found by 
long division: 
(r +1)(r? — 2r + 5) =0. 
The roots of the quadratic are, = 1 — 2iand nm = 1+ 2i. The general solution is 
y(t) = cye~! + cre! cos 2t + c3e! sin 2t. 
Example 2.14.6. Solve y’”” + 2y”+y=0. 
The characteristic equation is 


r4 +27? +1=0. 
It can be solved by factoring 
(7 +1) =0. 
(Or one could set z = r? and obtaina quadratic equation for z.) The roots are —i, i, each 
repeated twice. The general solution is y(t) = c, cost + c, sint + c3t cost + cyt sint. 
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Example 2.14.7. Solve y”” + 16y = 0. 
The characteristic equation is 


r+4+16=0. 


Its solutions are the four complex roots of —16, computed earlier: 2 +iV¥2and —V2 BE 
iv2. The general solution is 


y(t) = ce! cos(V2t) + c,eV2" sin(V2t) + cye~V2t cos(V2t) + c4e7 V2 sin(V2t). 
Example 2.14.8. Solve y©) + 9y"” = 0. 
The characteristic equation is 
P+9r=0. 
Factoring P(r? +9) = 0, we see that the roots are 0, 0, 0, —3i, 3i. The general solution 


is y(t) = cy + Cot + cst? + cq cos 3t + cs sin 3t. 


2.14.3 Nonhomogeneous Equations. The theory is parallel to the second-order 
case. Again, a particular solution is needed, to which we add the general solution of 
the corresponding homogeneous equation. 


Example 2.14.9. Solve y© + 9y"” = 3t — sin 2t. 

The general solution of the corresponding homogeneous equation was found in 
Example A particular solution is produced in the form Y(t) = Y¥,(t) + Y,(t), 
where Y,(t) is a particular solution of 


yl) 4 Oy” = 3t 
and Y,(t) is a particular solution of 


mw 


y® + oy” = —sin 2t. 
We guess that Y,(t) = At* and compute A = =, and we guess that Y,(t) = Bcos 2t, 


which gives B = ——, so that Y(t) = —t* — — cos2t. 
40 2 40 


1 1 : 
Answer. y(t) = at — = cos t +c + Cot + C3t? + c4 COS 3t + Cs sin 3¢. 


2.14.4 Problems. 
I. Solve the nonhomogeneous equations with the discontinuous forcing function. 


1. y" + 9y = f(t), where f(t) = 0 for 0 < t < zand f(t) =t fort > z, y(0) = 0, 
y'(0) = -2. 


Answer. 


—2 sin 3t, ift < z, 


()= 413 
: +4 7% cos3t — sin 3¢, ift > z. 
9 9 27 


2. y’ +y = f(t), where f(t) = 0 for 0 < t < zand f(t) =¢t fort > z, y(O) = 2, 
y'(0) = 0. 
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II. Find the general solution, valid for t > 0. 


1. 


10. 


11. 


t?y” — 2ty’ + 2y =0. 


Answer. y = cit + cyt. 


. fy" +ty' +4y =0. 


Answer. y = c, cos(2 In ft) +c, sin(2 Int). 


. ty" + 5ty’ + 4y =0. 


Answer. y = ¢t~* + cyt~? Int. 


. ty" + 5ty’ + 5y =0. 


Answer. y = ¢,t~* cos(In t) + c,t~? sin(In £). 


. ty" — 3ty’ =0. 


Answer. y = ¢, + ¢ot*. 


fe ge Rg Hd yy 
.y er y=0. 


Answer. y = evt + cyVtIn t. 


. 2t?y" + Sty’ +y =0. 


1 
Answer. y= ¢,t'2 +¢,t71. 


. 9t7y" — 3ty’ +4y =0. 


Answer. y = ¢,t?/? + cyt? Int. 


. 4x2y" (x) + 4xy'(x) + y(x) = 0, x > 0. 


1 . (1 
Answer. y = Cc, COS (; In x) +c, sin (; In x). 
Find the general solution of 


ae Gee t>0 
Yor Ey T py = : 


Hint. Look for a particular solution in the form y = *. 


cos(2 Int) is sin(21n t) 


C2 2 


Answer. y = 1 +c 
4 At : t t 


Use variation of parameters to find the general solution of 


nae? pee aus t>0 
y +> py = B’ * 
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Int cos(2 Int sin(2Int 
Answer. y = ae +n) +e). 


12. Find the general solution of 


By” + t?y” — 2ty’ + 2y =0. 
Hint. Look for a solution in the form y = t’. 
Answer. y = C1 + Cyt + cf. 


Ill. Find the general solution, valid for all t 4 0. 
1. t@y" + ty’ +4y =0. 


Answer. y = c, cos(2 In |t|) + cy sin(2 In |t]). 
2. 2t?y"” —ty’+y=0. 
Answer. y = evel +o|t| Y= evel + Cyt is also a correct answer). 
3. 4t7y" — 4ty’ + 13y =0. 
Answer. y = c\|t| cos (= In It!) + c|t| sin (5 In It). 
4. 9t7y" + 3ty’ +y =0. 
Answer. y = ¢,|t|!/3 + c,|t|!/ In |e]. 
5. 2ty” +y’ =0. 
Answer. y=c, + cael. 
6. 2t?y” —ty’+y =i? 3. 
Hint. Look for a particular solution as Y = At? + Bt + C. 
Answer. y = =f —34+¢yIt] + cl¢l. 
7. 2t2y" — ty’ + y =¢°. Hint. Look for a particular solution as Y = At?. 
Answer. y = =# + cyt] + cltl 
8. 2(¢+1)*y” — 3(t + ly’ + 2y =0,t #1. 
Hint. Look for a solution in the form y = (tf + 1)’. 


Answer. ¢c,/|t +1| + c(t + 1). 
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9. Solve the following integro-differential equation: 
ys) 


t 
4y'(t)+ | —~—ds=0, t>-1. 
ae an el 


Hint. Differentiate the equation, and observe that y’(0) = 0. 


1/2 1/2 


Answer. y=c[2(t+1) —(t+1) In(t +1)]. 


IV. Solve the following initial value problems. 


1. ty” — 2ty’ + 2y =0, y(1) = 2, y'(1) =5. 
Answer. y = —t + 3¢?. 

2. t?y" — 3ty' + 4y = 0, y(—1) = 1, y'(—1) = 2. 
Answer. y = t? — 4t7 In |¢|. 

3. t?y” + 3ty’ — 3y = 0, y(—1) = 1, y'(—1) =2. 
Answer. y = —23 — <t. 

4. t?y” —ty’ + 5y =0, y(1) =0, y'(1) =2. 
Answer. y = tsin(2 Inf). 

5. Py" + ty’ + 4y =0, y(-1) =0, ¥(-1) = 4. 
Answer. y = —2sin (2 In |t|). 


6. 6t7y” + ty’ +y =0, y(2) =0, y'(2) = 1. 
p\2 74/3 
Answer. y = 12 (:) - (+) | 
7. ty” +y’ =0, y(-3) = 0, y’(-3) = 1. 
Answer. y = 31n3 — 3In|t]. 


1 


8. 2t?y” — ty’ + y =0, y(—1) = 0, y'(-1) = ; 


Answer. y=t+ Viel. 
V. Solve the following polynomial equations. 


1. -1=0. 


, 270 7470 


1 1 
Answer. The roots arel,e 3,e 3. 
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2. 2>4+27=0. 
Answer. —3, a a3 2 + av3 
2 2 2 2 
3. r*—-16=0. 


Answer. +2 and +2i. 

4. -3r+r+1=0. 
Answer. 1,1 — /2, 1+ /2. 

5. 2r3 — 5r2+4r—1=0. 
Answer. , 1,1. 

6. +27 +r+2=0. 
Answer. —2, —i, i. 

7. 3r4 +573 +r2—r=0. 
Answer. 0, =, —1,-1. 


8. r44+1=0. 


7 370 57 . 77 


Answer, e'4,e4,¢4,¢ 4, 

9. r4+4+4=0. 
Answer. 1+i,1—i, -1 +i, —-1—-i. 

10. r++ 8r? +16 =0. 
Answer. 2i and —2i are both double roots. 

11. r4 +57? +4=0. 
Answer. +i and +2i. 

12. r°+7r444r?+4=0. 
Hint. Write the equation as r?(r*+ + 4) +r4+4=0. 


Answer. +i,1 +i, -1 +i. 


2.14. Linear Equations of Order Higher Than Two 113 


VI. Find the general solution. 


1 y"-y=0. 


tl2 ane V3 


cos — 
2 


V3 


Answer. y = cye! + ce t+c;e~"/? sin st 
2. y” — 5y”" + 8y’ —4y = 0. 
Answer. y = cye! + ce! + c,te”. 
3. y" —3y"+y'+y=0. 
Answer, y = ce + c,eA-V2t 4 cyeA+v20, 
4. y" —3y" +y' -3y =0. 
Answer. y = c,e*! +c) cost + ¢3 sint. 
5. yD — 8y" + 16y = 0. 
Answer. y = c,e~7! + ce”! + cgte~! + cyte’. 
6. y) + 8y” + 16y = 0. 


Answer. y = Cc, COs 2t + cz sin 2t + c3t cos 2t + cyt sin 2t. 


7. yO +y=0. 
Bs -.ok dhe, Sag See 
Answer. y = c,ev2 cos = v2 sin = e v2 cos — v2 sin =. 
swer. y = ce za t ce? sin = + ¢3 Sip tcye ¥? sin 
8. yy" -y=t?. 
3 mee 
Answer. y = —t? + cye! + c,e~"/? cos Va a c,e—*/2 sin ay, 


a 
9, yO) _y" =0, 
Answer. y = Cc; + Cot +c3e7' + cge’ +c; cost + Cy Sint. 


10. 2y” — 5y” + 4y' -—y =0. 
ly 
Answer. y = c\e2 +c,e' + ¢;¢e!. 


11. y©) — 3y" + 3y” — 3y”" + 2y’ =0. 


Answer. y = ¢, + ce! +. c3e7 +c, cost + cs sin t. 
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12. y®) —y© = sint. 
Answer. y = : sint + cy + Cot + cst? + cyt? + c5t* + cgt? + ce! + cget. 
13. y” + 4y = 4t? -1. 
Answer. y = t? — : + c,e' cost + c,e' sint + c,e~' cost + cye~ sint. 
14. y” —2y” — 8y' + l6y = 27e*. 
Answer. y = e~' + ce + c,te* + c,e~' cos /3t + cye~ sin V3t. 


VII. Solve the following initial value problems. 


1. y” +4y’ =0, y(0) = 1, y'(0) = —1, y’(0) = 2. 


Answer. y = 


NIwW 


* cos 2t — + sin 2t. 
2 2 
2. y’”" + 4y = 0, y(0) = 1, y'(0) = -1, y’(0) = 2, y’"”(0) = 3. 
Answer. y= —=e! (cost — 5sint) + =e! (3 cost — sint). 
3. y” + 8y = 0, y(0) = 0,7 y'(0) = 1, y"(0) = —2. 
Answer. y = —se%t + ae! cos /3t. 
4, y) + y = 1, y(0) = 1, yO) = -1, y"(0) = 1, y"(0) = -1, y"(0) = 2. 
t4 
Answer. y= — +e". 
24 
5. yl" + y" + y” + y' =_ 0, y(0) =_ 0, y'(0) =_ 3, y"(0) =_ -1, y"(0) — —1. 
Answer. y=1—e' + 2sint. 
6. y™" — 3y” — 4y = 0, y(0) = 1, y'(0) = -1, y"() = 4, y"(0) = 1. 
Answer. y = cosh 2t — sint. 
7. y©) — y' = 0, y(0) = 2, y'(0) = 0, y”(0) = 1, y’"(0) = 0, y”"(0) = 1. 


Hint. Write the general solution as y = c, +c, cost + c3 sint + cycosht + 
cs sinh t. 


Answer. y= 1+ cosht. 


Vil. 1. Write the equation (2.14.4) in the operator form 
L[y] = agy™ + ayy) + ++ + adp_ry’ + any = 0. (2.14.6) 


Here L[y] is a function of a function y(t), or an operator. 
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(i) 


(ii) 


(iii) 


Show that 
Le] =e" (agr™ + aur?) +--+ +. dy_yr + ay). (2.14.7) 
Assume that 7, isa real root of the characteristic equation (2.14.5), which 


is repeated s times, so that 
dor™ + ayr™ 1 + +) +a,_ir + Gy, = ag(r — 7) q(r), 


where q(r) is a polynomial of degree n — s, with q(,) # 0. Differentiate 
the equation (2.14.7) in r, and set r = n, to show that te’! is a solution 
of (2.14.4). Show that e”‘, te’, ...,t8~1e"1' are solutions of (2.14.6). 

Assume that p + iq and p — iq are roots of the characteristic equa- 
tion (2.14.5), each repeated s times. By the above, z,; = tkel(Ptint and 
z, = t*e(P-'9)! are solutions of (2.14.4), for k = 0,1,...,s — 1. By con- 


sidering ane and a justify that these roots bring the following 2s 
l 


solutions into the fundamental set: e?! cos qt and e?! sin qt, te?‘ cos qt 
and te” sin qt, ..., °~1e?' cos qt and t®—1e?" sin qt. 


2. Find the linear homogeneous differential equation of the lowest possible order 


that has the following functions as its solutions: 1, e 


Answer. y 


—2t sint. 


mn an 


+2y” +y" +2y' =0. 


3. Find the general solution of 


Hint. 


(t+1)*y” —4(t+ Dy’ + 6y =0. 


Look for the solution in the form y = (t +1)’. 


Answer. y = c(t +1)* +¢,(t + 1)°. 


4. Find the general solution of 


ty” + y" =- 1. 


2 
Answer. y= = +c, (tnt —1)+ cyt + ¢3. 


5. Solve the following nonlinear equation (y = y(t)): 


er 


ayy" — 3y 


(This equation is connected to the Schwarzian derivative, defined as S(y(t)) = 


yl (t) 


y(t) 


ea 
2\y@/) 


Hint. Write this equation as 
y" 3 y" 
yy 2y 
and then integrate, to get 
(3/2) 
y" =cy" 


Let y’ = v, and obtain a first-order equation. 
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Answer. y = 


cyt+c2 

: cyt+c. 
be written as y = +—. 
c3t+c4 


6. Consider the nonlinear equation 


y(t) +a(ty(t)=0, OK<t< 


oO, 


+3, and also y = cyt + c;. (Equivalently, the answer can 


where a(t) is a continuously differentiable function and a(t) > ag > 0 for all 
t > 0 and ag is a constant. Assume that either a’(t) > 0 or a’(t) < 0 for all 
t € [0, co). Show that any solution remains bounded on [0, oo). 


Hint. Consider the “energy” function E(t) = 


Ly? 


(t) + <a(y*(t). Using 


the equation, E’(t) = -a'(t)y*(0). In case a(t) < 0 — all t, the energy 
is pairaial and so y(t) is bounded. In case a’(t) > 0 for all t, we have 


EY) y Pek) 


E'(t)= 72 OY <a'(t) a(t)’ TO 


E(0) 


a(t) 


gee . Integrating this over (0, t), we 


get le: < a)” which implies that vO) < ror = constant. 


7. Find the homoclinic solutions of (a is a given number, u = u(x)) 


u" —au+2u3=0, -—0o<x<oo, u(—oo) =u'(—00) = u(co) = u'(oo) = 0. 


Hint. Multiply the equation by w’ and integrate: 


2 
ul” — a?u? + u* = constant = 


0. 


Solve this equation for u’, to obtain a first-order separable equation. 


a 
Answer. u(x) = —————,, for any number c. 
cosh a(x—c) 


8. (i) Solve the nonlinear equation (y = y(t)) 


” 1 f 
y = yO)=q, y(O)=p 


with the given numbers q # 0 and p. 


Hint. Multiply the equation by y’ to get 


< (y” + y) =0 


Integration gives 
2 1 
yo+y?=pt z 


Now multiply the equation by y: 


yy" -y?= 
Using (2.14.8), 
” 1 a - 
yy" =50) -Y"= = 5007)" +y?- 


Setting v = y’, obtain from 


(2.14.8) 


(2.14.9) 


a 2(p? . a v(0)= 4°, v'(0) = 2pq. 
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Answer. y = + (° + =) t2 + 2pqt + q?, with “plus” if q > 0 and 
q 


“minus” if q < 0. 
(ii) Solve Pinney’s equation (a > 0 is a constant) 
y"+a’y- = =0, y0)=q#0, y'(O)=p. 
Hint. Proceed similarly, and show that v = y? satisfies 


1 
v" + 4a*v = 2 (> + aq? + ae v(0) = q’,__-v'(0) = 2pq. 


\/(@at-p2q2=1) cos(2at)+2apq? sin(2at)+p2q?+a2q4+1 
Answer. y= ; 
V2aq 


(iii) Let w(x) and v(x) be the solutions of the linear equation 
y" + a(x)y =0, (2.14.10) 


for which u(x9) = q, u’(xX9) = p, and U(X) = 0, v’(xX9) = +. Here a(x) 
q 

is a given function, q # 0, p and xX, are given numbers. Use Theorem 

2.4.2) to show that their Wronskian W(x) = W(u, v)(x) satisfies 


W(x) = u'(x)v(x) — u(x)v'(x) = 1, for all x. 
(iv) Consider Pinney’s equation (more general than the one in part (ii)) 
y Faby + 5 =0, yOo)=a#0, yO) =P. 
with a given function a(x) and a constant c # 0. Show that its solution 


is 
y(x) = tV u?(x) — cv2(x), 


where one takes “plus” if q > 0 and “minus” if q < 0. 


Hint. Substituting y = u(x) — cv2(x) into Pinney’s equation and us- 
ing that uw” = —a(x)u and v” = —a(x)v, obtain 


Cu) — u@)'@P = 1 _ 


y" +a(x)y+ S 5 0. 
" [u2(x) — cv2(x)]2 


2.15 Oscillation and Comparison Theorems 


The equation 
y’ +n’*y =0 


has a solution y(t) = sinnt. The larger is n, the more roots this solution has, and so it 
oscillates faster. In 1836, J. C. F. Sturm discovered the following theorem. 
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Theorem 2.15.1 (The Sturm Comparison Theorem). Let y(t) and v(t) be, respectively, 
nontrivial solutions of the following equations: 


y" + b(t)y = 0, (2.15.1) 
v” + b,(t)v = 0. (2.15.2) 

Assume that the given continuous functions b(t) and b,(t) satisfy 
b(t) > b(t) forall t. (2.15.3) 


In case b,(t) = b(t) on some interval (t,, tz), assume additionally that y(t) and v(t) are 
not constant multiples of one another on (t,,t,). Then v(t) has a root between any two 
consecutive roots of y(t). 


Proof. Let t; < t, be two consecutive roots of y(t), 


y(t) = Wr) = 0. (2.15.4) 
We may assume that y(t) > 0 on (t, f2) (in case y(t) < 0 on (t,, t,), we may consider 
—y(t), which is also a solution of (2.15.1])). Assume, contrary to what we want to prove, 
that v(t) has no roots on (t,, t2). We may assume that v(t) > 0 on (t;, t,) (by considering 
—v(t), in case u(t) < 0). 


v(t) 


y(t) 


ty ty 
The functions y(t) and v(t). 


Multiply the equation by y(t), and subtract from that the equation (2.15.1), 
multiplied by u(t). The result may be written as 


(v'y — vy’) + (b, — b)yv = 0. 
Integrating this over (t), t,) and using gives 


tg 
—U(t2 )y'(t2) + v(t)’ (hy) + [ [b,(t) — b(t)] y(t)u(t) dt = 0. (2.15.5) 
ty 

All three terms on the left are nonnegative. If b,(t) > b(t) on some subinterval of 
(t,, t2), then the third term is strictly positive, and we have a contradiction. 

Now consider the remaining case when b,(t) = b(t) for all t € (t,, t,), so that the 
equations and coincide on (t, t2) and v(t) is a solution of (2.15.1). We 
claim that v(t) cannot vanish at t, and at t,, so that v(t,) > 0 and v(t,) > 0. Indeed, in 


Z 7 v(t). This function is a solution of 
v(t, 


(2.15.1), and z(t,) = y(t,) = 0, z’(t,) = y’(4), so that by the uniqueness of solutions for 
initial value problems, z(t) = y(t) for all t € (t,, t2), and then y(t) and u(t) are constant 
multiples of one another on (t,, t2), which is not allowed. It follows that v(t,) > 0 and 
similarly we prove that v(t) > 0. Clearly, y’(t;) > 0 and y'(t)) < 0. The uniqueness 


case U(t,) = 0, we consider the function z(t) = 
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theorem, Theorem)2.4. 1] for initial value problems implies that y'(t;) > 0 and y’(t,) < 0 
(otherwise, if say y’(t,) = 0, then y(t) = 0 for all t, by Theorem 2.4.1). Then the first 
two terms in (2.15.5) are strictly positive, and we have a contradiction in (2.15.5). © 


In case y(t) and v(t) are two solutions of the same equation (2.15.1), which are not 
constant multiples of one another, the theorem implies that their roots interlace, which 
means that between any two roots of one of the solutions there is a root of the other 
one. 

By a similar argument, one proves the following version of the Sturm comparison 
theorem, involving a differential inequality. 


Lemma 2.15.1. Assume that the functions u(t) and v(t) are twice continuously differen- 
tiable and that they satisfy 
v” +q(t)v =0, v(a)=0, 
u"+q(tu>0, u(a)=0, uwu'(a)>O0, (2.15.6) 


on some interval (a, b) (with a given continuous function q(t)). Then v(t) oscillates faster 
than u(t), provided that both functions are positive. Namely: 


(i) If v(t) > 0 on (a, b), then u(t) > 0 on (a, b). 


(ii) If, on the other hand, u(t) > 0 on (a, b) and u(b) = 0, then v(t) must vanish on (a, b]. 


Proof. Asin Theorem obtain 
(v'u— vu’) <0, for x € (a, b). (2.15.7) 
Let us prove (i). Assume that u(t) > 0 on (a, b), and contrary to what we want to prove, 


u(é) = 0 at some € € (a,b). 


Case 1. The inequality in (2.15.6) is strict on some subinterval of (a, €). The same is 


then true for the inequality (2.15.7). Integrating over (a, €), obtain 
—v(§)u'(§) < 0, 


which is a contradiction (because v(é) > 0, u’(€) < 0). 


Case 2. Assume that u” + q(t)u = 0 on (a, &). Then u(t) and v(t) are solutions of the 
same equation on (a, €), and u(a) = v(a) = 0. It follows that u(t) and v(t) are constant 
multiples of one another, but u(&) = 0, while v() > 0, a contradiction, proving the 
first part of the lemma. 


The second statement of the lemma is proved similarly. © 


We shall need the following formula from calculus, discovered by an Italian math- 
ematician Mauro Picone in 1909. 


Lemma 2.15.2 (Picone’s Identity). Assume that the functions a(t) and a,(t) are differ- 
entiable, the functions u(t) and v(t) are twice differentiable, and u(t) > 0 forall t. Then 


u fa y : mr uw m™! fo ti u , z 
[= waw — uayv )| = u(au’) — = av’) +(a-—a,)u +a, (u —<v') : 
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Proof. The derivative on the left is equal to 


u'v — uv’ 
ar (va —uayv') + = (o(au'y = u(ayv")') + (a= ay)= —u'v' =A+B+C. 
The middle term, B, is equal to the first two terms on the right in Picone’s identity. It 
remains to prove that A + C is equal to the sum of the last two terms on the right in 
Picone’s identity. We expand A and C and, after a cancellation, obtain 


2 u 2(uy, 2 u_,\? 
ont _ ! 2 aya ! ie = = ! | eee 
A+C=(a-a,)u +a,]u 27u'v +v (<) | (a—a,)u +a, (u =v’) ; 
completing the proof. © 


We now turn to the general second-order equations 
p(t)u” + q(t)u’ + r(t)u = 0. (2.15.8) 


Assume that the functions p(t), q(t), and r(t) are differentiable, with p(t) > 0 for all t. 
We divide this equation by p(t), 
o, ) ,  r© 


ut" Be Ou = 0, 


pw 


and then multiply by the integrating factor a(t) = e rin "Denoting b(t) = a(t)—— ae 


p(t)’ 
we arrive at 


(a(t)u’)’ + b(t)u = 0, (2.15.9) 
which is known as the selfadjoint form of (2.15.8). 


With the help of his clever identity, M. Picone was able to give the following gen- 
eralization of the Sturm comparison theorem. 


Theorem 2.15.2. Let u(t) and v(t) be, respectively, solutions of and 
(a,(t)v') + b,(t)v = 0. 


Assume that the differentiable functions a(t), a,(t) and the continuous functions b(t), 
b,(t) satisfy 

b(t) > b(t) and 0<aj,(t) < a(t) forall t. 
In case a,(t) = a(t) and b,(t) = b(t) on some interval (t,, t2), assume additionally that 


u(t) and v(t) are not constant multiples of one another on (t;, tz). Then v(t) has a root 
between any two consecutive roots of u(t). 


Proof. The proof is similar to that of the Sturm comparison theorem. Let t, < ft, be 
two consecutive roots of u(t), 


u(t,) = u(tr) = 0. (2.15.10) 
Again, we may assume that u(t) > 0 on (t,,t,). Assume, contrary to what we want 
to prove, that v(t) has no roots on (t,,t,). We may assume that v(t) > 0 on (ty, fy). 
Apply Picone’s identity to u(t) and v(t). Expressing from the corresponding equations 
as (a(t)u’)’ = —b(t)u and (a,(t)v’) = —b,(t)v, we rewrite Picone’s identity as 


[= (vau' — uayv')} = (b, — b)u? + (a— a,)ur + ay (w - Hy)! : 
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Integrating this over (t,, t,) and using (2.15.10) gives 


to tz 2 to Uu 2 
0= [ (b, — b)u? dt + [ (a—a,)u' dt+ [ a, (w - <u’) dt. 
ty ty 


ty 


(In case v(t,) = 0, we have u'(t,) > 0, by the uniqueness of solutions for initial value 


2u 


2 ! 
problems. Then lim,_,,, “= lim; 4, — = 0. Similarly, in case v(t,) = 0, the upper 
UD 


limit vanishes for the integral on the left.) The integrals on the right are nonnegative. 

We obtain an immediate contradiction, unless a,(t) = a(t) and b,(t) = b(t) for all 

t € (t,,t,). In such a case, we must also have u’ — “v' = 0on (ty, tz) (so that all 
UD 


, U 

three integrals vanish). But then f=, and integrating, we see that u(t) and v(t) are 
u UD 

constant multiples of one another, contradicting our assumption. © 


Our next goal is the famous Lyapunov inequality. It will follow from the next 
lemma. Define qt(t) = max(q(t), 0), the positive part of the function q(t). Simi- 
larly, one defines q~(t) = min(q(t), 0), the negative part of the function q(t). Clearly, 
q(t) = q(t) + q°(t). 


Lemma 2.15.3. Assume that u(t) is twice continuously differentiable and that it satisfies 
the following conditions on some interval (0, b) (here q(t) is a given continuous function): 


u"+q(tu=0, u(0)=u(b)=0, u(t)>O0O on(0,b). (2.15.11) 


Then 
b 


[ qt (t) dt > on 
a b 
Proof. From (2.15.11) it follows that 
u" +q*(t)u=—q (t)u > 0. 
Let u(t) be the solution of (c is any positive number) 
vp’ +qt(tu=0, v(0)=0, v’(0)=c>0. (2.15.12) 


By Lemma 2.15.1] v(t) must vanish on (0, b]. Let tz € (0, b] be the first root of v(t), so 
that v(t) > 0 on (0, fz). (In case q(t) = 0, we have ft, = b, because v(t) is a constant 
multiple of u(t).) Integrating (2.15.12) (treating q+ (t)v as a known quantity), 


t 
v(t) = ct — ii (t — s)q*(s)v(s) ds, for t € [0, ty]. (2.15.13) 
0 


From v(t,) = 0, it follows that c = = rs *(t, —s)q* (s)v(s) ds. Substituting this back into 
2 
(2.15.13), we express 


to t 
v(t) = 7 [ (t, — s)q*(s)v(s) ds — [ (t — s)q*(s)v(s) ds, for t € [0, ty]. 
0 0 
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Breaking the first integral, ie = fi + Tics we continue: 


t,v(t) = [ 


t to 
=(t,- of sqt (s)v(s) ds + rf (t, — s)q*(s)v(s) ds. 
0 t 


t 


ty 
[t(t2 — s) — ta(t — s)] q*(s)u(s) ds + t [ (tz — s)q*(s)v(s) ds 
t 


Let fo be the point of maximum of u(t) on (0, t,), U(tg) > 0. Estimate v(s) < u(t) in 
both integrals on the right and then evaluate the last formula at tg and cancel v(tg). 
Obtain 


to ta 
ig 2%) [ sq*(s) ds + to [ (ty — s)q*(s) ds 
0 to 


to ty 
< [ (t2 — s)sqt(s) ds + [ s(tp — s)q*(s) ds 
0 


to 
ty 
= i (t, — s)sq*(s) ds. 
0 


Dividing by t, gives 


2 s s ”b 
eal (1-Z)saroass | (1 F)sa* as < [ 7 (s)ds, 


which implies our inequality. (In the last step we estimated the function (1 — *)s by its 


; b 
maximum value of 7? © 


Theorem 2.15.3 (Lyapunov’s inequality). Ifa nontrivial solution of the equation 
u" + q(t)u =0 


has two roots on an interval [a, b], then 
b 


4 
+ = 
[ q (‘)dt > 7. 


Proof. Let t, and t, be two consecutive roots of u(t), a < t; < ty < b. We may assume 
that u(t) > 0 on (t,, f2) and use the above lemma: 
b tz 
4 4 
awar> f qt (t)dt > >>: 
[ a t,-t, — b-a 


(We may declare the point tf, to be the origin, to use the above lemma.) © 


Remarkably, the constant 4 appears in another well-known and useful inequality. 


Theorem 2.15.4 (Hardy’s inequality). Assume that f(x) is a continuously differentiable 
function on [0, b], where b > O is arbitrary and f(0) = 0. Then 


b b 
[ FS ax <a [ f(x) dx. 
0 0 


2.15. Oscillation and Comparison Theorems 123 
Proof. Write 
2 1 ae 
pre [secs + x¥?2 (x12 f) 
1 3 = = f ae / 
= 4x 2f2 4 (x-N2f)(x-V2p)’ + (av (x-¥2f) ) 
Integrating both sides and dropping a nonnegative term on the right, 


b b 1 b i b 
i cies) dx = 1 < x7? f? dx + as Cas 8) (xr Uf) dx >-— i x7? f2 dx, 
0 0 4 (0) 4 0 


' b 
because i be A ie 77) dia 7), = ~b-1 f(b) > 0. (Observe that 
limy so X71 f(x) = limy 4g 22 - tim, 9 f(&) = f") -0 = 0.) 6 


x 


2 


Using Infinite Series to Solve 
Differential Equations 


“Most” differential equations cannot be solved by a formula. One traditional approach 
involves using infinite series to approximate solutions near some point a. (Another 
possibility is to use numerical methods, which is discussed in Chapters [I] and 9.) We 
begin with the case when the point a is regular and it is possible to compute all deriva- 
tives of solutions at x = a, and then we write down the corresponding Taylor’s series. 
Turning to singular a, we distinguish the easier case when a is a simple root of the 
leading coefficient (we call such equations mildly singular). Then we show that the 
case when a is a double root of the leading coefficient can often be reduced to a mildly 
singular case, by a change of variables. 


3.1 Series Solution Near a Regular Point 


3.1.1 Maclauren and Taylor Series. Infinitely differentiable functions can often 
be represented by a series 


F(X) = Ag + A,X + GQ? $e + AQXT + or, (3.1.1) 


Letting x = 0, we see that ag = f(0). Differentiating (B.1.1) and then letting x = 0 
shows that a, = f’(0). Differentiating (B.1.1)) twice and then letting x = 0 gives a, = 


” (n) 
me Continuing this way, we see that a, = f _ giving us the Maclauren series 
2 m n! 
"(0 (n)(9 oo FM (9 
fo) = f+ POx+ O24 ..4 Ons = Y OOO en, 
! ! = ! 


It is known that for each f(x) there is a number R, so that the Maclauren series con- 
verges for x inside the interval (—R,R) and diverges outside of this interval, when 
|x| > R. We call R the radius of convergence. For some f(x), we have R = oo (for 
example, for sin x, cos x, e*), while for some series R = 0, and in general 0 < R < ow. 


125 
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Computing the Maclauren series for some specific functions gives 


3 5 7 2n+1 
ee i 
ne Tg | - Ye Zz Qn+1)V 

2 4 6 2n 

x x x x 

=1-—- — — — a -—1)" —_, 
oe a al et x Onl 
n=0 
2 3 4 baad n 
as Og a et 
oe ae ee al = nl” 
1 fo} 
——| 
rap lt ete + = 2 


The last series, called the geometric series, converges on the interval (—1, 1), so that 
R=1. 


Maclauren’s series gives an approximation of f(x), for x close to zero. For example, 
sinx * x gives a reasonably good anon en for |x| small. If we add one more 


term of the Maclauren series, sinx ~ x — = then, say on the interval (—1, 1), we get 
an excellent approximation; see Figure B.1] 


y= sin x 


Figure 3.1. The approximation of y = sinx by y = 
3 
x—- = near x = 0. 


If one needs the Maclauren series for sin x”, one begins with a series for sin x and 
then replaces each x by x?, obtaining 


x6 x10 a xAn+2 
sin x2 =x? = —— — _ 
Tae = Gnd Dr 


One can split Maclauren’s series into a sum of series with either even or odd pow- 
ers: 


no  (2n)! 1 (2n + 1)! 


y - wn) a 3 7) CP) 2 fer) yanel. 
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In the following series only the odd powers have nonzero coefficients: 


ioe) 


1-(-1)"_, 
2 


All of the series above were centered at 0. One can replace zero by any number a, 
obtaining Taylor’s series 


fx) = f@ + f'(@x - a) + 
co rn) 
= > f De a)". 
n=0 


ni 


” (n) 
f tO se ead £ Doe — a) + 


2! n 


It converges on some interval (a — R,a + R), centered at a. The radius of convergence 
satisfies 0 < R < o, as before. Taylor’s series allows us to approximate f(x), for 
x close to a. For example, one can usually expect (but this is not always true) that 


f(x) © f2) + f(x —-2) + £2 


2! 
Clearly, pain a,x" = eae Anx™, so that the index n can be regarded as a “dummy” 
* , —-x"*! into the 


(x — 2)’, for x close to 2, say for 1.8 < x < 2.2. 


index of summation. It is often desirable to put a series like Pint 7 
~~" A 


form >) a,x”. We setn +1 =m, orn = m-—1, and get 


son m1 n—-l 

xntl — x” = x", 
ear ame aaa 
n=1 m=2 n=2 


The same result can be accomplished in one step, by the shift of the index of summation: 
n > n—1, or replacing each occurrence of n by n—1 and incrementing by 1 the limit(s) 
of summation. 


3.1.2 A Toy Problem. Let us begin with the equation (here y = y(x)) 
y"+y=0, 


for which we already know the general solution. Let us denote by y, (x) the solution of 
the initial value problem 


y"+y=0, yO)=1, y(0)=0. (3.1.2) 
By y2(x) we denote the solution of the same equation, together with the initial con- 
ditions y(0) = 0, y'(0) = 1. Clearly, y,(x) and y,(x) are not constant multiples of 
each other. Therefore, they form a fundamental set, giving us the general solution 
YX) = C1) + Co¥2(X). 
Let us now compute y,(x), the solution of (8.1.2). From the initial conditions, we 
already know the first two terms of its Maclauren series 


(x) = yo) + "Ox ¢ LO? 4. 4 PO 


xP pee, 
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To get more terms, we need to compute the derivatives of y(x) at zero. From the equa- 
tion @.1.2), y”(0) = —y(0) = —1. We now differentiate the equation (8.1.2), getting 


mw 


y” + y’ = 0, and then set x = 0 to obtain 
y" (0) =- —y'(0) _ 0. 

+y" = 0, and setting x = 0, 
y"" (0) =_ —y”(0) =-_ 1. 


mn 


Differentiating again gives y 


In the next step, 

yO) = -y"(0) = 0. 
We see that all derivatives of odd order vanish at x = 0, while the derivatives of even 
order alternate between 1 and —1. The Maclauren series is then 


yy(x) =1- = + a — +++ = cosx. 
Similarly, we compute the series representation for y2(x): 
Pe 
yo(x) = x - 3 + = sin x. 
We shall solve the equations with variable coefficients 
P(x)y” + Q(x)y’ + R(x)y = 0, (3.1.3) 


where continuous functions P(x), Q(x), and R(x) are given. We shall always denote by 
y,(x) the solution of satisfying the initial conditions y(O) = 1, y'(0) = 0, and by 
y2(x) the solution of satisfying the initial conditions y(0) = 0, y’(0) = 1. If one 
needs to solve (8.1.3), together with the given initial conditions 


yO)=a, yO)=8, 
then the solution is 
y(x) = ary, (x) + By2(x). 
Indeed, y(0) = ay,(0) + By2(0) = a, and y'(0) = ay; (0) + By3(0) = B. 


3.1.3 Using Series When Other Methods Fail. Let us try to find the general 
solution of the equation 

y"+xy' +2y=0. 
This equation has variable coefficients, and none of the previously considered methods 
y) (0) 


n! 


will apply here. Our goal is to use the Maclauren series ae x" to approximate 


solutions near x = 0. 

We shall derive a formula for y“”)(0) and use it to calculate the solutions y,(x) and 
y2(x), defined in the preceding subsection. From the equation, we express y”(0) = 
—2y(0). Differentiate the equation 

y" + xy” + 3y’ =- 0, 
which gives y”’(0) = —3y’(0). Differentiate the last equation again, 
yn" + xy” + 4y" _ 0, 
and get y’””(0) = —4y”(0). In general, we get a recurrence relation 
y (0) = —ny"-2)(0), n= 2,3,... (3.1.4) 


By convention, y(x) = y(x), so that y(0) = y(0). 
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Let us begin with the computation of y,(x), for which we use the initial conditions 
y(0) = 0, y’(0) = 1. Then, using the recurrence relation (8.1.4), obtain 


y"(0) = -2y(0) = 0 
y"(0) = -3y'(0) = -3-1, 
y(0) = 4y"(0) = 0. 


It is clear that all derivatives of even order are zero at x = 0. Let us continue with the 
derivatives of odd order: 


y©(0) = —5y""(0) = (-1)25 - 3-1, 
y(0) = —7y" (0) = (-1)37-5-3-1. 


In general, 
yent+) (0) = (-1)"(2n +1) -(2n—1)--+3-1 


Then the Maclauren series for y2(x) is 


oo 4(2n+1) 
116) = FO er ara FO ae 


(2n+1)-(2n—1)-:-3-1 yontl 


=x 3 (-1)" 
ct (2n + 1)! 
as 1 
cd —1 MA 2n+1 
a 2 Ye On a 
One can also write this solution as y,(x) = ae gi-L)” =x gen, 
nt 


To compute y,(x), we use the initial conditions y(0) = 1, y’((O) = 0. Similarly to 
the above, we see from the recurrence relation that all derivatives of odd order vanish 
at x = 0, while the even ones satisfy 


y@)(0) = (—1)"2n - (2n — 2) +++ 4-2, for n = 1, 2, 3,.... 
This leads to 


ny? 7)(0) n 1 n 
nO) = 14 LC 1) (Gn)! - =14 6 1)" Gia) G@a=)534" 


The general solution is 


7 (=i)? n n nt 
wona(L+ Daa aa ta BO 1) a x2n+1 


We shall need a formula for repeated differentiation of a product of two functions. 
Starting with the product rule (fg)’ = f’g + fg’, express 


Gey afer 2r es ties 
(fg)” = f"get 3f"g' + 3f'g a" + fe”, 


and in general, for the nth derivative, 
(fg) = fg + npg’ + AA por-dg 


-1 
fs mn ae 2) +4 nf’ gin 1) + fe. 


mn 1) 
(3.1.5) 
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(Convention: f©® = f.) This formula is similar to the binomial formula for the expan- 
sion of (x + y)”. Using the summation notation, we can write it as 


n 


(fa = i (rePg®, 


where (") = —" _ are the binomial coefficients. 
k/ — kl(n—k)! 


The formula (8.1.5) simplifies considerably in case f(x) = x, or if f(x) = x?: 


(xg) = ngir-)) + xg”, 
(x2) = n(n — 1)g-?) + Anxg@—-D + x29), 


(n) 
cane (x—a)", to solve 


We shall use Taylor’s series centered at x = a, y(x) = Din= eae; 
= nt 


linear second-order equations with variable coefficients 
P(x)y" + Q@x)y' + ROx)y = 0, 


where the functions P(x), Q(x), and R(x) are given. A number a is called a regular 
point if P(a) # 0. If P(a) = 0, then x = ais called a singular point. If a is a regular 
point, we can compute y“”)(a) from the equation, as in the examples above. If the point 
a is singular, it is not even possible to compute y”(a) from the equation. 


Example 3.1.1. (2 + x*)y” — xy’ + 4y = 0. 

For this equation, any a is a regular point. Let us find the general solution as an 
infinite series, centered at a = 0, the Maclauren series for y(x). We differentiate both 
sides of this equation n times. When we use the formula to differentiate the first 
term, only the last three terms are nonzero, because the derivatives of 2 + x?, of order 
three and higher, are zero. Obtain 

nin—1 
[(2+ yr] = mn = Doyo +4 n(2x) yt) +4 (2 A x?) y42), 
When we differentiate xy’ n times, only the last two terms survive, giving 


Cy ny +4 xy"), 


[xy'] 
It follows that n differentiations of our equation produce 
n(n—1) 


ag ee + n(2x)y"tD + (2 + x2)yt2) — ny — xy@tD 4 4y™ = 0, 


Set here x = 0. Several terms vanish. Combining the like terms, we get 
2y+2)(0) + (n? — 2n + 4) yO) = 0, 


which gives us the recurrence relation 
n?—2n+4 


This relation is too involved to get a general formula for y“)(0) as a function of n. 
However, it can be used to crank out the derivatives at zero, as many as you wish. 

To compute y,(x), we use the initial conditions y(0) = 1 and y’(0) = 0. It follows 
from the recurrence relation that all of the derivatives of odd order are zero at x = 0. 
Setting n = 0 in the recurrence relation, obtain 


y"(0) = —2y(0) = —2. 
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When n = 2, 
y"" (0) = -2y"(0) = 4. 


Using these derivatives in the Maclauren series gives 
Ghia 
y(x) =1—x* + 6% a aa 


To compute y(x), we use the initial conditions y(O) = 0 and y’(0) = 1. It follows 
from the recurrence relation that all of the derivatives of even order are zero. When 
n = 1, we get 


vy") =-5y'O = -5. 


2 
Setting n = 3, obtain 
7 21 
(5) Ere eagill ria 
y9(0) = -Sy"(0) = F. 


Using these derivatives in the Maclauren series, we conclude 


= 1 3 fi 5 
yn(x) = x q* + 769% oe 


The general solution is 
YX) = C11 (X) + C2Ya(*) 


1 1 7 
=o (1-2? + oxt4--)4e(x- 38 + os +), 


4 160 
Suppose that we wish to solve the above equation, together with the initial con- 
ditions: y(0) = —2, y'(0) = 3. Then y(0) = c,y,(0) + %y2(0) = cy = —2, and 


y'(0) = cy, (0) + c2y3(0) = cy = 3. It follows that yx) = —2y,(x) + 3y2(x). If one 
needs to approximate y(x) near x = 0, say on the interval (—0.3, 0.3), then 
1 1 i 
pp ee ae Sec ry Ss eS 
V(x) & 2(1 x? + ox*) 43(x 4% +x’) 


will provide an excellent approximation. 


Example 3.1.2. y” —xy’+y=0,a=0. 
Differentiating this equation n times gives 


yr (x) — ny (x) = xy D(x) + yYM(X) = 0. 
Setting here x = 0, we obtain the recurrence relation 
y42)(0) = (n= Dy™(0). 


To compute y,(x), we use the initial conditions y(0) = 1, y’(0) = O. Then all 
derivatives of odd order vanish, y2”+))(0) = 0, as follows by repeated application of 
the recurrence relation. We now compute the derivatives of even order. Setting n = 0 
in the recurrence relation gives y’(0) = —y(0) = —1. When n = 2, we get y””(0) = 
y"(0) = —1, and then y(0) = 3y’"(0) = -1- 3, atn = 4. We continue, y®(0) = 
5y()(0) = —1- 3-5, and in general 


y?(0) = -1-3+5+++(2n— 3). 
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Then 


ad (2n+1) 
ya) =14 YO an + ry ©) ane 


L Gn)! (n+)! ~ 
_ 1-¥ ae Ss 3) i 
a) ore ore 


1 2n 
-y —_) yan, 
#4, 20ni (an = 1) 


To compute y(x), we use the initial conditions y(0) = 0, y’(0) = 1. Then all 
derivatives of even order vanish, y?”)(0) = 0, as follows by repeated application of the 
recurrence relation. Setting n = 1 in the recurrence relation gives y’””"(0) = 0, and so 
all derivatives of odd order vanish as well. We conclude that y,(x) = x. The general 
solution is 


yx) = =Cy » ‘aoa + Cox. 


Example 3.1.3. Approximate the general solution of Airy’s equation 


y" = xy = 0, 
near x = 1. This equation was encountered in 1838 by G. B. Airy in his study of optics. 
We need to compute Taylor’s series about the regular point a = 1, which is y(x) = 


oe) (n) 
Dt * © (x — 1)". From the equation, 
~ nt 
y"Q) = yQ). 


To get higher derivatives, we differentiate our equation n times and then set x = 1, to 
get the recurrence relation 


yl"#2)(x) — ny"D(x) = xy™Qx) = 0 


y@42)(1) = ny*®-Y) + yO), «=n = 1,2... (3.1.6) 
To compute y,(x), we use the initial conditions y(1) = 1, y’(1) = 0. Then 
y"Q) = yQ) = 1. 


Setting n = 1 in the recurrence relation gives 
yd) = yQ) +) = 1. 


When n = 2, 
yO) = 2y/() + y"Q) =1. 
Then, for n = 3, 
yO) = 3y"(1)+y"(1) =4 
— (e-1? , &— , & Dt, &— 
y(x) = 14+ 5 + 6 + 7A + 30 + 
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Again, it does not seem possible to get a general formula for the coefficients. 

To compute y,(x), we use the initial conditions y(1) = 0, y’(1) = 1. Then y"(1) = 
y(1) = 0. Setting n = 1 in the recurrence relation @.1.9), gives y)(1) = y(1) + y'(1) = 
1. When n = 2, y(1) = 2y’(1)+y"(1) = 2. Then, forn = 3, y(1) = 3y"(1)+y""(1) = 
1. Obtain 
12 = 120 
The general solution is, of course, y(x) = cy, (x) + c2y2(x). 


yx(x) = x-1+ tee, 


ca , ead @-1P 


3.2 Solution Near a Mildly Singular Point 
We consider again the equation 
P(x)y" + Q@x)y! + ROx)y = 0, 


with given functions P(x), Q(x), and R(x) that are continuous near a point a, at which 
(n) 
ce (y — a). If P(a) = 0, 


n=0 yn! 
we have a problem: one cannot compute y”(a) from the equation (and the same prob- 
lem occurs for higher derivatives). However, if a is a simple root of P(x), it turns out 
that one can still use series to produce a solution. Namely, we assume that P(x) = 
(x — a)P(x), with R(a) # 0. We call x = aa mildly singular point. Dividing the 
Q(x) _ RO) 
? r(x) = 
Pi (x) Pi (x) 


we wish to compute the solution as a series y(x) = >} 


equation by A(x) and calling q(x) = , we put it into the form 


(x — a)y" + q(x)y' + rQx)y = 0. 
The functions q(x) and r(x) are continuous near a. In case a = 0, the equation becomes 
xy" + q(x)y’ + r(x)y = 0. (3.2.1) 


For this equation we cannot expect to obtain two linearly independent solutions by 
prescribing y,(0) = 1, y;(0) = 0 and y,(0) = 0, y5(0) = 1, the way we did before. This 
equation is singular at x = 0 (the functions qe) and we are discontinuous at x = 0, 


x x 
and so the existence and uniqueness theorem, Theorem does not apply). 


Example 3.2.1. Let us try to solve 
xy"—y'=0, yO) =0,y'(0) = 1. 


Multiplying through by x, we obtain Euler’s equation with the general solution y(x) = 
c)x? +c). Then y’(x) = 2c,x, and y'(0) = 0 # 1. This initial value problem has no 
solution. However, if we change the initial conditions and consider the problem 


xy"-y'=0, y(0)=1,y'(0) =0, 


then there are infinitely many solutions y = 1 + c,x?. 

We therefore lower our expectations, and we shall be satisfied to compute just one 
series solution of (8.2.1). It turns out that in most cases it is possible to calculate a series 
solution of the form y(x) = er a,x”, starting with ag = 1, which corresponds to 
y(0) = 1. df ag # 1, then = y(x) is another solution of (8.2.1), which begins with 1, so 


that we shall always assume that dy = 1. The possibility of ag = 0 is considered later.) 
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Example 3.2.2. Find a series solution, centered at a = 0, of 
xy” + 3y' —2y=0. 


It is convenient to multiply this equation by x: 


x?" + 3xy’ —2xy =0. G23) 
Look for a solution in the form 
co 
oe > A,X” = Ag + A,X + anxX* +03;x%7 +---, 
n=0 


with ag = 1. Calculate 


ce 
y= > a,nx"-! = a, + 2a,x + 3a3x7 +--, 
n=1 


<< 
Il 


Cc 
ve a a,n(n — 1)x"-? = 2a, + 6a3xX +-*. 


n=2 


Observe that each differentiation “kills” a term. Substituting y = see a,x" into the 


equation (8.2.2) gives 


by a,n(n —1)x" + p? 3a,nx" — 3 ja. = 0, (3.2.3) 
n=2 n=1 


n=0 


The third series is not “lined up” with the other two. We therefore shift the index of 
summation, replacing n by n — 1 in that series, obtaining 


co co 
> Ja, 4 = » 2a,_,x". 
n=0 n=1 


Then (8.2.3) becomes 
foe) foe) foe) 
> a,n(n — 1)x" + > 3a,nx" — > 2Ay,_ 1x" = 0. (3.2.4) 
n=2 n=1 n=1 


We shall use the following fact: ip as b,x" = Ofor all x, then b, = Oforalln = 1, 2,.... 
Our goal is to combine the three series in into a single one, so that we can set 
all of the resulting coefficients to zero. The x term is present in the second and third 
series, but not in the first. However, we can start the first series at n = 1, because at 
n = 1 the coefficient is zero, so that becomes 


[oe] eo [oe] 
b> a,n(n — 1)x” + > 3a,nx” — oe 2ay,_\x" = 0. 
n=1 n=1 n=1 
Now for all n > 1, the x” term is present in all three series, so that we can combine 
these series into one series. We therefore just set the sum of the coefficients to zero, 
a,n(n — 1) + 3a,n — 2ay_; = 0. 
Solve for a,, to get the recurrence relation 


2 
= ——a4,_}, >1. 
On n(n+2) "2 7 
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Starting with ag = 1, compute a, = =. Then 


22 _ 2? 32 
02 = 7-44 23-4) 2141 
2 oe 
8 age ash 
gntl 
and, in general, a, = TEs 


A = 46 n+l ne . 
ne Wx) es Linzi nae ~ din=0 nea : 


gntl 


Example 3.2.3. Find a series solution, centered at a = 0, of 
xy” —3y'-—2y=0. 


This equation is a small modification of the preceding one, so that we can quickly derive 


the recurrence relation: 
2 


If we start with ag = 1 and proceed as before, then at n = 4 the denominator is zero, 
and the computation stops! To avoid the trouble at n = 4, we look for the solution in 
the form y = a 44x". Substituting this series into the equation 


An n>1. (3.2.5) 


xy" — 3xy’ — 2xy =0 


(which is the original equation, multiplied by x) gives 
Y) ann(n — 1)x" — D) 3a,nx" — DY) 2a,x"*) = 0. 
n=4 n=4 n=4 


The coefficient in x*, which is a,(4- 3-3-4), is zero for any choice of a,. We can then 
begin the first two series at n = 5: 


>) ann(n — 1)x" — }) 3a,nx" — }) 2a,x"*! = 0. (3.2.6) 
n=5 n=5 n=4 


Shifting n > n—1 in the last series in (8.2.4), we see that the recurrence relation (B.2.5) 
holds for n > 5. We choose a, = 1 and use the recurrence relation (3.2.5) to calculate 
as, Ag, etc. 


2 2 2 2? 22 
Compute as = —a4, = —, da = —a, = —— = 24—, and in general, a, = 
P ie ee a em | 612!’ 8 ann 
gn-4 
ni(n—4)! 
oo gn-4 oo gn-4 
Answer, y(x) = x* + 24 ———_ x" =24 ——__ x", 
y ) Dinas ni(n—4)! din=a ni(n—4)! 


Our experience with the previous two problems can be summarized as follows 
(convergence of the series is proved in more advanced books). 


Theorem 3.2.1. Consider the equation (8.2.1). Assume that the functions q(x) and r(x) 
have convergent Maclauren series expansions on some interval (—6, 4). If q(O) is not a 
nonpositive integer (q(0) is not equal to 0, —1, —2,...), one can find a series solution of the 
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form y(x) = ee =9 4nx", Starting with ag = 1. In case q(0) = —k, where k is a nonnega- 
tive integer, one can find a series solution of the form y(x) = > nak+1 An» Starting with 
Ax41 = 1. In both cases, the series for y(x) is convergent on (—6, 6). 


We now turn to one of the most important examples of this chapter. 


Example 3.2.4. xy” + xy’ + (x?—v7)y =0. 


This is the Bessel equation, which is of great importance in mathematical physics! 
It depends on a real parameter v. It is also called Bessel’s equation of order v. Its solu- 
tions are called Bessel’s functions of order v. We see that a = 0 is not a mildly singular 
point, for vy # 0. (Zero is a double root of x.) But in case v = 0, one can cancel x, 
putting Bessel’s equation of order zero into the form 


xy" +y' +xy =0, (3.2.7) 
so that a = 0 isa mildly singular point. We shall find the solution of this equation as a 
series centered at a = 0, the Maclauren series for y(x). 


We put the equation back into the form 


x*y" + xy’ + xy =0 


and look for a solution in the form y = pee a,x", with ag = 1. Substitute this in: 


foe) foe) foe) 
Y) ann(n — 1)x" + Y) aynx" + >) ayx"*? = 0. 
n=2 n=1 n=0 

In the last series we replace n by n — 2 


ce co co 

b} a,n(n — 1)x" + > a,nx” + »} An—-2xX" = 0. 

n=2 n=1 n=2 
None of the three series has a constant term. The x term is present only in the second 
series. Its coefficient is a,, and so 

a, = 0. 
The terms involving x”, starting with n = 2, are present in all series, so that (after 
combining the series) 
a,n(n —1)+a,n + ay_2 = 0, 


giving 
1 
Ay = a 
This recurrence relation tells us that all odd cociiicionts are Zero, Az,,, = 0. Starting 
; 1 1 1 
with dp 7 1, compute a, = —S = — 53 oe — a, = = (-1?— a a a 
(-1) Pree and in general, 
dn = (“1 a = (-1)"_+—_,, == Saas 
Ls 224262 --. (2n)2 Cn ete 2n)y an jy" 


We then have 


y(x) =1+ y AgnX”"” =1+ iG 1" Pn mye" = = Xe 1)" acm 2 aay xn, 


n=1 


We obtained Bessel’s TCU of order zero of the first kind, with the customary notation: 


Jo(x) = Dn-o(-2)" a 


22n(niy2~ 
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Figure 3.2. The graph of Bessel’s function Jo(x). 


3.2.1* Derivation of J,(x) by Differentiation of the Equation. It turns out 
that one can obtain Jo(x) by differentiating the equation and using the initial conditions 
y(0) = 1 and y’(0) = 0, even though the point a = 0 is singular. 
Differentiate the equation (8.2.7) n times, and then set x = 0: 
nytt) +4 xyln+2) + yrt) +4 ny) +4 xy = 0; 
ny*D(0) + yY*0(0) + ny"Y(0) = 0 

(It is not always true that xyrt2) — 0asx — 0. However, in case of the initial condi- 
tions y(0) = 1, y/(0) = 0, that is true, as was justified in the author’s paper [[16].) We 
get the recurrence relation 


(n+1) ae ae (n-1) 
yortD(Q) = Fy"), 


We use the initial conditions y(0) = 1, y'(0) = 0. Then all derivatives of odd order 
vanish, while 


yen (9) = a yen 2)(0) 
en —12n-3 ay 
=a on naa 
_ n(2n — 1)(2n — 3)+++3 +1 
mre Srna a)2 Y) 
_ n(2n — 1)(2n — 3)+++3+1 
hem 2"n! 


Then 


5 YOM) an n n 
yx) = . (2n)! xan = = Ye 1) ae xi. 


We obtained again Bessel’s Posen of order zero of the first kind, 


Jo(x) = ye Sra xn. 
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In case of the initial conditions y(0) = 0 and y’(0O) = 1, there is no solution of 
Bessel’s equation (the recurrence relation above is not valid, because the relation 
xyr+2) — 0as x —> Ois not true in this case). In fact, the second solution of Bessel’s 
equation cannot possibly be continuously differentiable at x = 0. Indeed, by Theorem 


1 
the Wronskian of any two solutions is equal to ce / ¥ ™ 


WY — Viz = ~. The solution Jo(x) satisfies Jo(0) = 1, (0) = 0. Therefore, the 
other solution, or its derivative, must be discontinuous at x = 0. It turns out that the 
other solution, called Bessel’s function of the second type and denoted Yo(x), has a term 
involving In x in its series representation; see the book of F. Bowman (Bl) for a concise 
introduction. 

Bessel’s function of order v of the first kind is denoted by J,(x). Similarly to Jo(x), the 
function J,(x) is continuous at x = 0, and it has an infinite sequence of roots, tending 
to infinity; see [BJ]. 


= 2 so that W(1, y2) = 


3.3 Moderately Singular Equations 


This section deals only with series centered at zero, so that a = 0, and the general case 
is similar. We consider the equation 


x?y” + xp(x)y’ + q(x)y = 0, (3.3.1) 


where the given functions p(x) and q(x) are assumed to be infinitely differentiable 
functions that can be represented by their Maclauren series 


p(x) = p(0) + p’(0)x + : p"(0)x? + --- 
(3.3.2) 


x 1 a 
q(x) = q(0) + q'(O)x + 54"(0)x? +++. 
(Observe the special form of the coefficient function in front of y’.) If it so happens 
that q(0) = 0, then q(x) has a factor of x, and one can divide the equation (8.3.1) by x, 
to obtain a mildly singular equation. So that the difference with the preceding section 
is that we now allow the case of q(0) # 0. Observe also that in case p(x) and q(x) are 
constants, the equation (8.3.1) is Euler’s equation, which was studied in Section 2.13} 
This connection with Euler’s equation is the “guiding light” of the theory that follows. 
We change to a new unknown function v(x), by letting yx) = x"v(x), with a 
constant r to be specified. With y’ = rx’~!v+x"v' andy” = r(r—1)x"~*v + 2rx" 1! + 
x'v", we substitute y(x) into @.3.1), obtaining 

xlt2y" 4 x"t1! (2r + p(x)) + x"v[r(r — 1) + rp(x) + q(x)] = 0. (3.3.3) 

Now choose r to satisfy the characteristic equation 
rir — 1) + rp(0) + q(0) = 0. (3.3.4) 


(We shall only consider the case when this quadratic equation has two real and distinct 
roots.) In view of (8.3.2), the quantity in the square bracket in (3.3.3) then becomes 


1 1 
rp'(O)x + r5p"(O)x? ++ + q'(O)x + 54 (0)x? nat 


so that it has a factor of x. We take this factor out and divide the equation @.3.3) by x” ae. 
obtaining a mildly singular equation. We conclude that the substitution y(x) = x"v(x), 
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with r being a root of (8.3.4), produces a mildly singular equation for v(x), which was 
analyzed in the preceding section. 

If 7, and 4, are real roots of the characteristic equation (8.3.4), then we get solu- 
tions of in the form y, = x"v,(x) and yz = x"2v (x), where v;(x) and v2(x) are 
solutions of the corresponding mildly singular equations. This approach will produce 
a fundamental set of (8.3.1), except if 7, and r, are either the same or differ by an inte- 
ger. In those cases y,(x) and y,(x) may coincide, and one needs a different method to 
construct another solution; see the book of W. E. Boyce and R. C. DiPrima [4]. 


Example 3.3.1. Solve 2x*y” — xy’ +(1+x)y =0. 
To put this equation into the right form (8.3.1), divide it by 2: 


1 1 1 
et | er , = or a 
xty" — 5xyl + (5 + 5*)y 0. (3.3.5) 
Here p(x) = -* and q(x) = ; + =x. The characteristic equation is then 
1 1 
ire = 0, 
r(r—1) at + 5 0 
Its roots arer = - andr =1. 


1 
The caser = We know that the substitution y = x2v will produce a mildly 


singular equation for v(x). Substituting this y into our equation (or using (@.3.3)) 
gives 


5/2" ne (5s 4 ee —0. 
2 2 
Dividing by x*/? produces a mildly singular equation 
xv" + Li + a =0. 
2 2 
Multiply this equation by 2x, for convenience, 


2x2v" + xv’ + xv = 0, (3.3.6) 
and look for a solution in the form v(x) = Te a,x”. Substituting v(x) into (B.3.4) 
gives 
co co co 
Eo 2a,n(n — 1)x" + a a,nx” + > a,x"t! = 0. (3.3.7) 
n=2 n=1 n=0 


To line up the powers, shift n > n — 1 in the last series. The first series we may begin 
at n = 1, instead of n = 2, because its coefficient at n = 1 is zero. Then becomes 


ce co co 
» 2a,n(n — 1)x” + » a,nx" + > Ayn_-1x" = 0. 
n=1 n=1 n=1 


Combine these series into a single series, and set its coefficients to zero, 
2a,n(n — 1) +a,n+ay_, =0, 


which gives us the recurrence relation 


1 


ay, = nn —1)"-h 
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1 1 1 1 
Starting with a, = 1, compute a, = ——, a, = ——a, = (-1)* ,a, =-—a = 
5 sd Bere Te aa waaay aa 


(-1)3 EEE and in general 


1 


= (—1)? ——________ 
On = (“1 35 Ona 1) 
We obtained the first solution: 


1 n 


= 71/2 = yl/2 ~7)n = 
yy (x) = x°/*v(x) = x ae 1) Ads S.Gn= 1” . 


The caser = 1. Set y = xv. Substituting this y into (8.3.5) and simplifying, 


x3v" + Sxt0/ + 5x0 =0. 
Dividing by x? gives a mildly singular equation, 
xv" + 3y + ly = 0. 
2 2 
Multiply this equation by 2x, for convenience, 
2x2v" + 3xv' + xv = 0, (3.3.8) 


é F oo) F 3 * = 
and look for a solution in the form v = )),_, @,x”. Substituting v(x) into G.3.8), 
obtain 


co co ce 
> 2a,n(n — 1)x" + p> 3a,nx" + ny ot =i, 
n=2 n=0 


n=1 


We start the first series at n = 1 and make the shift n — n — 1 in the third series: 
eo fo} Co 
> 2a,n(n — 1)x" + > 3a,nx” + » Ayn) x" = 0. 
n=1 n=1 n=1 


Setting the coefficient of x” to zero, 
2a,n(n — 1) + 3a,n + ay_; = 0, 


gives us the recurrence relation 


1 
a, = ———-aQ,,_1. 
" n(22n+1) "" 

7 eee a ee a a 
Starting with ag = 1, compute a; = Wy ® 55u (-1) Aas. a3 
a =) 

5702 (—1) fanaa in general 


1 


= (—1)? ——______ 
Ono aes One Dy 
The second solution is then 


1 43 
x é 
n+ 3*5-(0n $1) 


yo(x) = x]}1+ >) (-1” 
n=1 


The general solution is, of course, y(x) = cy, + C2). 
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Example 3.3.2. Solve x?y” + xy’ + (x? — yy =0. 


This is Bessel’s equation of order =. Here p(x) = 1, and q(x) = x* — =. The 
characteristic equation 
1 
rr—-—1)+r—==0 
9 
1 1 
has roots r = = and r = 7 
1 = qs at aE yee 
The case r = = Set y =x 3v. Compute y’ = 3% 3U+x 3U',y" = ea 


4 1 
=x 30’ +x 3v”. Substituting this y in and simplifying produces a mildly singular 


equation, 
xv" + x +xv=0. 
Multiply this equation by 3x, 
3x2v" + xv’ + 3x2v = 0, (3.3.9) 


and look for a solution in the form v = )~ 
gives 


nzo nx". Substituting this series into (8.3.9), 


ce ce co 
> 3a,n(n — 1)x" + » ay,nx” + pS 30,5? =O) 


n=2 n=1 n=0 
We shift n — n — 2 in the last series: 


a 3a,n(n — 1)x" + > a,nx” + > 3ay,_2x" = 0. 
= n=1 = 


The x term is present only in the second series. Its coefficient must be zero, so that 
a, =0. (3.3.10) 
The term x”, with n > 2, is present in all three series. Setting its coefficient to zero, 
3a,n(n — 1) + ay,n + 3ay,_2 = 0, 
gives us the recurrence relation 


3 
n(3n — 2) Gn—2- 


All odd coefficients are zero (because of (3.3.10)), while for the even ones our recur- 
rence relation gives 


a, =— 


3 
azn = Baas =) A2n-2- 
32 
: i _ ae — (_1)2 _1)3 
Starting with ag = 1, compute a, = Fr = (-—1)* ———_ eayaior = (-1) ESTRCET eS ETAT 
and in general, 
3n 

6 8) —————————————— 
Gon = (“I"m (4-10 (on =D) 

The first solution is then 


3h 2n 
4-.-2n)(4-10---(6n —2)) 


ys (x) = x73 [1+ ue I" 
n=1 
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1 z 12 i 2 -5 2% 

The caser = 3 Set y = x3v. Compute y’ = 3x 3v +x3U',y"= ox 3u+t sx 3U' + 

1 
x3v”. Substituting this y into our equation and simplifying produces a mildly singular 
equation 

n” 5 ra 
xv + 30 +xv=0. 
Multiply the last equation by 3x, 
3x2v" + 5xu’ + 3x2v = 0, 
and look for a solution in the form v = ees a,x". Substituting this in, we conclude 
again that a, = 0 and that the following recurrence relation holds: 
2 a 

n(n +2) "7" 

It follows that all odd coefficients are zero, while the even ones satisfy 


ay, = 


Gan ~~ Fn(6n + 2) 27-2 ~~ In(an + 2/3) 2-2" 
We then derive the second solution 


. n 1 n 
ya(x) = XP 1 + LV (2-4---2n) (2+ 2/3) -(4 +4 2/3) (n+ aBy)* 


3.3.1 Problems. 


I. Find the Maclauren series of the following functions, and state their radius of con- 
vergence. 


1. sin x?. 
1 

2. —. 

14+x2 

43 

3. xe~*. 


II. 1. Find the Taylor series of f(x) centered at a. 
(i) f(x) =sinx,a= i 

(ii) f(x) =e*,a=1. 

(iii) f(x) = ~, a=1. 


co =614(-1)? , 1m 1 ay 
2. Show that >), a Ss pa sem 
l-—cosnm yy _ ) 2 2n-1 


= ———~ 
n3 dna (2n—1)3 


3. Show that )y"_, 


Hint. cosnz = (—1)". 


n+3 n+1 _ co n+2 n 


4. Show that >), _, aa Dign4 aan 


5. Show that )y"_) ayx"*? =) 


n=2 
0° n+3 42 __ yo nt+1 

6. Show that ies ni(n+l) at | pee tmopineD” 
(n) 


An—2x". 


7. Expand the nth derivative: [(x? + x)g(x)] 


Answer, n(n — 1)g"~2)(x) + n(2x + 1)g-Y (x) + (x? + x) g(x). 
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8. Find the nth derivative: [(x? + xx]. 
Answer. 2”~2e?* [n(n — 1) + 2n(2x + 1) + 4(x? + x)]. 
9. Expand the nth derivative: [xy |”. 
Answer. ny + xy@, 
ings 


10. Expand the nth derivative: [(x? + 1)y” 


Answer. n(n —1)y + 2nxy@D + (x2 +1) yr), 


11. Let y(x) = paar a,x". Show that y'(x) = ey a,nx"—! and y"(x) = 
pees a,n(n — 1)x"-?, 
12. Let y(x) = ye. ++". Show that y"(x) = ba — 1) yn-2 ang 


n=1 pn\(n-1)! 
" foe} 1 
xy (x) ma ey waa 


Conclude that y(x) is a solution of 


n=2 (n-1)\(n—2)! 


xy"-y=0. 
Can you solve this equation by another method? Hint. Probably not. 


Il. Find the general solution, using power series centered at a (find the recurrence 
relation and two linearly independent solutions). 


1. y’—xy’-y=0,a=0. 


co 86 xan ioe) 1 2 
Answer. y,(x) = i= sn? Y20%) = pyaan Gn ntl 


2. y" —xy’+2y=0,a=0. 
ae, ee a ee ee eee 
Answer. y,(x) = 1—x*, y,(x) =x eX ~ Dor ; 
3. (x2? + Dy" +xy' +y =0,a=0. 


Answer. The recurrence relation is y"+2)(0) = —(n? + 1)y(0). 


Ne 2 A dp oe 
x= 1— =x —X" +, x)=x-—=x =X? ee 
yy (x) go Mog ya(x) go he 
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10. 


11. 
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. (x2 + Dy” + 3xy'+y=0,a=0. 


Answer. The recurrence relation is y"+2)(0) = —(n + 1)? y(0). 


00 1-3---(2n—1 © 2.4.--2 
ya) = Daeo(—1)" a, ya(x) = ner eat enn pice 


2"n! 1-3-5---(2n+1) 
. (x2 + Dy” — xy’ +y =0,a=0. 
Answer. The recurrence relation is y"+2)(0) = —(n — 1)? y™(0). 
co 12.32...(2n—3) 
yi@) = 1+ Dy EE 2, yaa) = x. 


.y’-xy=0,a=2. 


1 


— — Beet 
Tha 2) ; 


Answer. y,(x) =1+(x—2)? + ~(x —2)> + ~(x —2)+ 


1 


Yalx) = (x — 2) + (e -— 29 + H(x- 2) + SX - OP 


.y’-xy -y=0,a=1. 


Answer. y,(x) =1+ (x —1/+ ~(x —1)?+ ~(x —1)*+-5, 


yo(x) = (x — 1) + “(x - 12 + “(x - 13 + Le = Neer 


/y"+(x4+2)y' +y =0,a = -2. 


Answer. The recurrence relation is y"+?)(—2) = —(n + 1)y(—2). y,(x) = 


c% ¢_4yn_1 2n a Fane 2nt1 
Sco( Ls (x + 2)", al) = Deo -D" ge + et 
.y’+(e41)y’ -y=0,a=-1. 
Answer. The recurrence relation is y“"+?(-1) = -—(n — Dy (-1). 
yx) = 1+ De (Ye + 1)", yo) SH. 


2ni(n—1) 
xy” +y=0,a=-2. 
Answer. The recurrence relation is y°"+2)(—2) = ; [ny@*D(—2) + y(—2)]. 
y,(x) = 1+ (+2)? 2 (x42) +--+, yo(x) = X+24—(x423 +o (x+2)44---. 
Ye y= OS, 


Hint. Before using the recurrence relation 
yO) =n Dy O) = aay YA) yy W); 
calculate from the equation y”(1) = —y(1) and y”(1) = —2y(1) — y’(1). 
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Answer. y,(x) =1-— s(x —1)- Gs —1)- T(x —1)*+-,y,(x)=x-1- 
=(x— 1) - <(x- 1) ++». 


IV. 1. Find the solution of the initial value problem, using power series centered at 
0, 
y” —xy’+2y=0, y(O)=1, y(0)=2. 


Answer. y=1+2x —x?—- =x3 ater 


2. Find the solution of the initial value problem, using power series centered at 
2, 
y"—2xy=0, y(2)=1, y(2)=0. 


Answer. y = 1+ 2(x — 2) + (x — 29) + (x -2)4 ++. 


3. Find the solution of the initial value problem, using power series centered at 
—1, 


y"+xy=0, y(-1)=2, y(-1)=-3. 
Answer. y = 2—3(x +1) +(x+1)*—- “(x +13 +05, 


4. Find the solution of the initial value problem, using power series centered at 
0, 
(1+ x*)y” —2xy’+2y=0, y(0)=1, y'(0)=-2. 


Hint. Differentiate the equation to conclude that y’’(x) = 0 for all x, so that 
y(x) is a quadratic polynomial. 


Answer. y = 1— 2x — x?. 


V. Find one series solution of the following mildly singular equations, centered at 
a=0. 


1. 2xy” +y'+ xy =0. 


Answer. 


2 4 6 


eit et 8 
2-3 2-4-3-7 2-4-6-3-7-11 
eee —])tx2n 
= ee a 
4 2nn!3-7-11---(4n—1) 


2. xy" +y'-y=0. 


co x? 
n=0 (n))2° 


Answer. y= >) 
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. Find one series solution in the form y = )}} 
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. xy” +2y'+y=0. 


co (-1)" n 


Answer. y= pan aaa 


. xy” +y' —2xy =0. 


oe} 1 2n _ oo 1 2n 


Answer. y= 1+ Deca 2n(n!)2 > Lin=0 2n(n!)2 


. xy" +y'+xy=0. 


foe) 


Answer. y = >), (—1)? —— 2", 


=0 22n(n!)2 


(oe) 


nas anx" of the following mildly 


singular equation, centered at a = 0: 
xy” —4y'+y=0. 


ol (-1)"-5 
n=6 n\(n—5)! 


co = (—1)"-5 n 


N=5 n\(n—5)! 


Answer. y = x° +120) e120 5, 


. Find one series solution of the following mildly singular equation, centered 


ata = 0: 


xy” —2y’-2y=0. 


Hint. Look for a solution in the form y = ae a,x", starting with a3 = 1. 


n-3 8 3n-3 
sneet = 8D : 
n\(n—-3)! 


=x ——__— 
Answer. y= x°+6)),_ n=3 GT 


. Find one series solution of the following mildly singular equation, centered 


ata = 0: 


xy"+y=0. 
Hint. Look for a solution in the form y = ae a,x", starting with a, = 1. 


a fe gh pe CD" en 


n=2 ni(n-1)! n=1 y\(n-1)! 


Answer. y=x+) 


. Recall that Bessel’s function Jo(x) is a solution of (for x > 0) 


xy"+y' +xy=0. 


Show that the “energy” E(x) = y'7(x) + y*(x) is a decreasing function. Con- 
clude that each maximum value of Jo(x) is greater than the absolute value of 
the minimum value that follows it, which in turn is larger than the next max- 
imum value, and so on (see the graph of Jo(x), Figure B.2)). 
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5. Show that the absolute value of the slope of the tangent line decreases at each 
consecutive root of Jo(x). 


Hint. Use the energy function E(x) from the preceding problem. 


VII. We assume that a = 0 for all problems of this set. 
1. Verify that the Bessel equation of order 1/2 
xy" + xy’ +(x? —1/4)y =0 


has a moderate singularity at zero. Write down the characteristic equation, 
and find its roots. 


(i) Corresponding to the root r = 1/2, perform a change of variables y = 
x!/2v, and obtain a mildly singular equation for v(x). Solve that equa- 
tion, to obtain one of the solutions of the Bessel equation. 


ae /2 co (=x? ] -1/2 co (=1)P x20] 
Answer. y = x [2 ee ee =x [x + net ark 


x72 sin x. 


(ii) Corresponding to the root r = —1/2, perform a change of variables 
y = x7!p, and obtain a mildly singular equation for v(x). Solve that 
equation, to obtain the second solution of the Bessel equation. 


-1/2 


Answer. y= xX COS x. 


(iii) Find the general solution. 


1/2 1/2 


Answer. y = c,x~*/* sin x + c)x7*/* cos x. 
2. Find the fundamental solution set of the Bessel equation of order 3/2 


xy" + xy’ + (x? — 9/4)y = 0. 


Answer. y, = i 14 a 
es oe n=l pigen(143)(245)--(n+5) | 
3 
=f ee Pe (-1)"x2" 
vax ? 1 - pace mes | 


3. Find the fundamental solution set of 


2x7y" + 3xy’-(1+x)y =0. 


1 n 
Answer. y, = x2|1+ > 5 
nswer. yy x | ao ar aus | 


eras | Ce, 1 eee aa 
y2 =X [2 x ee | 
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4. Find the fundamental solution set of 
9x2y" + (2—x?)y = 0. 


: x? x4 
Answer. yexi(l+ 54 ++), 
5-6  5-6-11-12 


2 l x2 x4 
= 3 — es oe 
y= % ( + oat ent ) 
5. Find the fundamental solution set of 
Qx7y" +(2+x)y =0. 


6. Find the fundamental solution set of 
2x7y" + 3xy' — (x7 +1y =0. 


A L T x2 x4 1(4 DAS ad 
nswer. =x2 — 47 4...) y =x7 cal aes egege Bape 
swer. yy (i+5+~4 Ja (145454 ) 


The Laplace Transform 


The method of Laplace transform is prominent in engineering, and in fact it was de- 
veloped by an English electrical engineer—Oliver Heaviside (1850-1925). We present 
this method in great detail, show its many uses, and make an application to the historic 
tautochrone problem. The chapter concludes with a brief presentation of distribution 
theory. 


4.1 The Laplace Transform and Its Inverse 


4.1.1 Review of Improper Integrals. The mechanics of computing the inte- 
grals, involving infinite limits, is similar to that for integrals with finite end points. 


For example, 
co co 
1 1 
—2t dat - —_ —2t =-, 
[ a a 


Here we did not set the upper limit t = oo but rather computed the limit as t > oo 
(the limit is zero). This is an example of a convergent integral. On the other hand, the 


integral 
it t dt = Int iF 
rf 


is divergent, because Int has an infinite limit as f — oo. When computing improper 
integrals, we use the same techniques of integration, in essentially the same way. For 


example 
co co 
1 1 1 
for di = |-5te — ze'|| ar 
i 2 4 a 


Here the antiderivative is computed by the guess-and-check method (or by integration 
by parts). The limit at infinity is computed by l’H6pital’s rule to be zero. 
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4.1.2 The Laplace Transform. Let the function f(t) be defined on the interval 
[0, co). Let s > 0 be a positive parameter. We define the Laplace transform of f(t) as 


F(s) = [ eS" F(t) dt = £(f(), 
0 


provided that this integral converges. It is customary to use the corresponding capital 
letters to denote the Laplace transform (so that the Laplace transform of g(t) is denoted 
by G(s), of h(t) by H(s), etc.). We also use the operator notation for the Laplace trans- 
form: £(f(t)). 

We now build up a collection of Laplace transforms: 


foe) 


© —st 
L£(1) -{ dais) = 
A Sle 8 
foo) = ce foe) 
Lit)= | e™tdt = |-£ ate -| ae 
A s s? |l, — s? 


Using integration by parts (n is a positive integer) 


ents oy n 
+ al er is 5 Fn). 
0 


ce 
oe") = [ et? dt = — 
0 0 
n 
(Here lim,_,,, e~‘t” = lim,, / - 0, after n applications of l’H6pital’s rule.) With 
too t>o ost pp p 
ic 
; ; 2 2 
this recurrence relation, we now compute L(t?) = = £0) = -- = =<, L(t) = 
S S S S 


3 ct) = 4, and in general 
Ss s4 


n! 
ny — 
L(t ) ~ gntl 3 
The next class of functions is the exponentials e“ where a is some number: 
eo foo} 1 
L(e") = e “eM dt = — eS-ayt| — _—_| provided that s > a. 
0 s-a (0) sS-—a 


Here we had to assume that s > a, to obtain a convergent integral. 
Next we observe that for any constants c, and c, 


L£(c f(t) + egg(t)) = c,F(s) + c2G(s), (4.1.1) 
because a similar property holds for integrals (and the Laplace transform is an integral). 


This formula expands considerably the set of functions for which one can write down 
the Laplace transform. For example, with a > 0, 


7 Lor Lyra) 21 11 ss 
£(coshat) = £(5¢ + 5e So esg ae for s>a. 
Similarly, 
: a 
A(sinh at) = s——3; for s>a. 


The formula (4.1.1) holds with an arbitrary number of terms, and it allows us to com- 
pute the Laplace transform of any polynomial. For example, 


L (205 — 34? +5) = 2£(¢5) — 3£(t?) + 5£(1) = ae . “ ‘ >, 
Compute 
ms —st : 7 oo 
£(cos at) = i e~* cos at dt = eee ee) = =) 
0 s? + a2 9 68 +a2 
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(One guesses that the antiderivative of e~** cos at is of the form Ae~ cos at+Be~ sin at 
and then evaluates the constants A and B by differentiation.) Similarly, 


= e—*t(ssin at + acosat)|~ a 
£(sin at) = e—* sinatdt = — = ; 
- Ss? + a? o ste 


For example, 
1 1 1 Ss 
6 (c0s?3t) = (24 ooset) = 24 8. 
(cos? 32) a a 2s * 22 + 36) 
If c is some number, then 


L(e" f(t) = [ ee F(t) dt = [ e~-)t F(t) dt = F(s —c). 
0 0 


We derived the shift formula: 
L£(e" f(t) = F(s —¢). (4.1.2) 
For example, 


x (e sin 3t) = Gora 


(Start with £ (sin 3t) = = and then perform the shift s > s — 5, to account for the 
Ss 


extra exponential factor e>’.) Here is another example: 


S+2 
£ (e~*' cosh 3t) = ——-_—_.. 
(e~* cosh 31) Ga229 
In the last example, c = —2, so that s—c = s + 2. Similarly, 


| 
x (e't?) = wo 


4.1.3 The Inverse Laplace Transform. This is just going from F(s) back to f(t). 
We denote it by £~! (F(s)) = f(t). We have 


£~" (¢,F(s) + ¢2G(s)) = a f (0) + crg(t), 
corresponding to the formula @.1.1), read backwards. Each of the formulas for the 
Laplace transform leads to the corresponding formula for its inverse: 


cc 1 = t” 
gntl } nv’ 


ae a) esas 
1 1 
-1 as 
= (ara) ~ a 
£7( 1 ) = eat 
s—a > 


and so on. For example, 


1 1 1 lt 
-1 _ -1 _— : 
: (een (ta) = dans 
4 


To compute £~!, one often uses partial fractions, as well as the inverse of the shift 


formula (4.1.2) 


LV(F(s—c)) =e" fo), (4.1.3) 
which is also called the shift formula. 


152 Chapter 4. The Laplace Transform 


Example 4.1.1. Find £7! (==). 
Ss 
Breaking this fraction into a difference of two fractions, obtain 


3s—5 S 1 5 
-1 =3f7-1 _ orl _ 3G 
= (S>)- 34 (s+) SL (=) 3 cos 2t 5 Sin 2t. 


: -1 2 
Example 4.1.2. Find £ ( ) 


We recognize that a shift by 5 is performed in the function at Begin by inverting 


: : 2 3 : . : 
this function, £~! (=) — =, and then account for the shift, according to the shift 


s4 
formula (4.1.3): 


Example 4.1.3. Find £7! (4). 
s“—-S— 
Factor the denominator, and use partial fractions 


S+7 S+7 _ 2 1 
st—s—6 (s—3)(st+2) s—3 s+2’ 


which gives 


on (gig) 


The method of partial fractions is reviewed in the appendix. 


3 2 
Example 4.1.4. Find £7! jp) 
s4410s2+9 


Again, we factor the denominator and use partial fractions 


1 5 5 3 
+2 -s+12_ S42 —-st12_ aha STG 
s4410s2+9 ~— (s24+1)(s?+9)  s241 s24+9° 


which leads to 


jf 12 


1 
344 108249 = q- cost + 5sint + 5cos 3t + sin 3). 


Example 4.1.5. Find £~! ( ——.). 
Ss S 


One cannot factor the denominator, so we complete the square 
2s-1 — 2-1 —_ Ast+1)—3 
s?4+2s+5  (s+1)2?+4  (s+1)2+4 
and then adjust the numerator, so that it involves the same shift as in the denominator. 
Without the shift, we have the function —. with the inverse Laplace transform equal 
Ss 
to 2 cos 2t — : sin 2t. By the shift formula .1.3), obtain 


2s—1 3 
-1 —-t _ 2 o-te 
L [as 5 oye =) 2e—* cos 2t 5° sin 2t. 
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4.2 Solving the Initial Value Problems 


Integrating by parts, 
L(y'(t)) = ii e-“y'(t) dt = [eyo] + sf e- y(t) dt. 
0 0 


Let us assume that y(t) does not grow too fast, as t > oo, so that |y(t)| < be“, for some 
positive constants a and b. If we now require that s > a, then the limit as t > oo is 
zero, while the lower limit gives —y(0). We conclude 


L(y'(t)) = —y(0) + sY(s). (4.2.1) 


This formula shows that the Laplace transform of the derivative of y(t) is obtained from 
the Laplace transform of y(t) by a simple algebraic operation. To compute the Laplace 
transform of y”(t), we use the formula (4.2.1) twice: 


L(y"(t)) = £("())') = —y'(0) + SLO") = —y’(0) — sy(0) +. s?¥(s). (4.2.2) 
In general, 


L(y (t)) = —y"-D(0) — sy("-2)(0) — --- — s™1y(0) + s"Y(5). (4.2.3) 


Example 4.2.1. Solve y” + 3y’ + 2y = 0, y(0) = -1, y'(0) =4. 
Apply the Laplace transform to both sides of the equation. Using the linearity of 
the Laplace transform (the formula (4.1.1})) and that £(0) = 0, obtain 


L(y") + 3L(y") + 2L(y) = 0. 
By the formulas (4.2.1), (4.2.2), and our initial conditions (£ (y(t)) = Y(s)), 
—y’ (0) — sy(0) + s*Y(s) + 3(—y(0) + s¥(s)) + 2Y(s) = 0, 
—4+s+s?Y(s)+3(1+sY(s)) + 2Y(s) =0, 
(s? + 3s+2)Y(s)+s—1=0. 
Solve for Y(s): 
1l-s 
S?4+3s+2° 


To get the solution, it remains to find the inverse Laplace transform y(t) = £~1(Y(s)). 
We factor the denominator and use partial fractions 


1l-s _ 1-s _ 2 3 
st+3st+2 (s+1)(st+2) st+1l s+2 


Y(s) = 


Answer. y(t) = 2e~! — 3e774. 


Of course, this problem could also be solved without using the Laplace transform. 
The Laplace transform gives an alternative solution method, it is more convenient for 
discontinuous forcing functions, and in addition, it provides a tool that can be used in 
more involved situations, for example, to solve partial differential equations. 


Example 4.2.2. Solve y” — 4y’ + 5y = 0, y(0) = 1, y/(0) = —2. 
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Apply the Laplace transform to both sides of the equation. Using the initial con- 
ditions, obtain 


2—s+s*Y(s) —4(—1 + sY(s)) + 5Y(s) = 0, 
s—6 
Y(s) = —————_-. 
(s) s2?—4s+5 
To invert the Laplace transform, we complete the square in the denominator and then 
produce the same shift in the numerator: 
s-6 _ (s—2)-4 


Y(s) = ——_—- = —& 
(s) s—4s+5 (s—2)2+1 
Using the shift formula leads to the answer: y(t) = e~! cost — 4e” sint. 


Example 4.2.3. Solve 


y" +@*y=5cos2t, w#2, 
y0)=1, yO)=0. 


This problem models a spring, with the natural frequency w, subjected to an exter- 
nal force of frequency 2. Applying the Laplace transform to both sides of the equation 
and using the initial conditions, we get 


5s 
+4’ 
_ 5s jee S 
~ (s2 +4)(s? +02) 8? +02" 


—s + s?Y(s) + w*Y(s) = 
Y(s) 


The second term is easy to invert. To find the inverse Laplace transform of the first 
term, we use the guess-and-check method (or partial fractions) 


ara  wolsa-oms| 
(s? + 4)(s?+ 02) w2-41527+4 s2+02]" 


5 


w2—-4 


Answer. y(t) = 


(cos 2t — cos wt) + cos wt. 


When w approaches 2, the amplitude of the oscillations becomes large. 
To treat the case of resonance, when w = 2, we need one more formula. Differen- 
tiate in s both sides of the formula 


F(s) = [ e-St f(t) dt, 
0 
to obtain 
P(s)=— [ ee f(t) dt = —L(tf(O), 
0 
or 


E(t f(t)) = —F'(s). 


For example, 


L(t sin 2t) = —£ c¢sin 2t) = -<( Z ) pal 


25a) Grae (4.2.4) 
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Example 4.2.4. Solve (a case of resonance) 


y” +4y = 5cos2t, 
yO) =0,  y"(0) = 0. 


Using the Laplace transform, obtain 


58 
ey 4Y(s) = ——_, 
P¥(9) +4¥() =z 

5S 

Y(s) = ——... 
(s) (s? + 4)2 


Then, using @.2.4), y(t) = 1 sin 2t. We see that the amplitude of oscillations (which 


is equal to 1) tends to infinity with time. 


Example 4.2.5. Solve the initial value problem for the fourth-order equation 


aa 


ys, 
yO=1, yO)=0, y"O)=1 y"(O)=0. 


Applying the Laplace transform, using the formula (4.2.3) and our initial condi- 
tions, obtain 


—y'"(0) — sy"(0) — s?y’(0) — s?y(0) + s*¥(s) — Y(s) = 0, 
(st —1)Y(s) =s? +5, 


¥(s) = Sts ss?+1) _ 3 5 
~ st—1 (s2-1)(s2 41) s?-1° 


We conclude that y(t) = cosht. 


4.2.1 Step Functions. Sometimes an external force acts only over some time in- 
terval. One uses step functions to model such forces. The basic step function is the 
Heaviside function u,(t), defined for any positive constant c by 


0 if0<t<c, 


u(t) = | 


1 ift>c. 
,u 
u(t) 
1 
| lg >t 
c 


The Heaviside step function u,(t). 


(Oliver Heaviside, 1850-1925, was a self-taught English electrical engineer.) Using 
u,(t), we can build up other step functions. For example, the function u(t) — u3(t) is 
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equal to 1 for 1 < t < 3 and is zero otherwise. Indeed, 
0-0O=0, if0<t<l1, 
u(t) -—u3(t) =41-0=1, ifl<t<3, 
1-1=0, ift>3. 


,u 
uy (t) — us(t) 
+1 —_—_________—_e 
——_————_o —$<$ $$ > 
1 3 


The graph of u,(t) — u3(t). 
The function [u,(t) — u,(t)] t? models a force that is equal to t? for 1 < t < 3 and 


is zero for other ft. 
Compute 


i —st 7 —st ese 
L£(u,(t)) = e-“u(t) dt = e"dt= — 
0) c 


Correspondingly, 


co (—) =H), 
2 


t < 7 and to zero for all other t > 0, then 


lA wu 


For example, if f(t) is equal to 3 for 
F) = 3 [ug(t) — u7(4)], and 
e72s e77s 
AF) = 3£(u2(1)) — 3£(uy()) = 3—— — 3. 
We compute the Laplace transform of the following “shifted” function, which “be- 


gins” at t = c (itis zero for 0 < t < c): 


£L (u(t) f(t —©)) = im ey (t) f(t —c)dt = i e—* f(t —c) dt. 
(0) c 


In the last integral we change the variable t — z, by setting t —c = z. Then dt = dz, 
and the integral becomes 


te e+) F(z)dz = eS ie e~*7 f(z)dz = e-“ F(s). 
0 0 
The result is another pair of shift formulas: 
£(u,(t) f(t — c)) = eS F(s), (4.2.5) 
Ll (e-SF(s)) = u(t) f(t —c). (4.2.6) 
For example, 
ens 


£(uz(t\(t —1)) =e SL) = = 
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, y=f® t y=u(t)f(t—c) 


The function y = u,(t) f(t —c). 


Using that £7! (=) = sint, obtain 
s24]1 


-1(.- 1 : . 
i (c ms) = u,(t) sin(t — 2) = —u,(t)sint. 


Example 4.2.6. Solve 


y"+9y=ut)—ugt), yO)=1, y'O)=0. 


Here the forcing term is equal to 1, for 2 < t < 4, and is zero for other t. Taking the 
Laplace transform and then solving for Y(s), we have 


5 e72s 
s*Y(s) —s+9Y(s) = = ‘ 


—2s 1 = e745 1 : 
s(s? + 9) s(s? + 9) 


Using the guess-and-check method (or partial fractions) 


Ss 
Y(s) = ——— 
(s) Sag ts 


1 = s 
s(s?+9) 9Ls s24+9]’ 


and therefore 


1 1 1 
Lot =—— fe 
Ce + 5) 9 9 coe? 
Using (4.2.6), we conclude 
y(t) = cos 3t + up(t) E - ; cos 3(t — 2)| — u,(t) E — : cos 3(t — 4)| : 
Observe that the solution undergoes jumps in its behavior at t = 2 and at t = 4, which 
corresponds to the force being switched on at t = 2 and switched off at t = 4. 
Example 4.2.7. Solve 
y" +4y= g(t),  y(0) = 0, -y'(0) = 0, 
where g(t) is the ramp function: 


gar if0 <t <1, 
Ba ift> 1. 


Express 
g(t) = — u(t) + mt) = t — (H(t — D, 
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so that by the shift formula @.2.5) its Laplace transform is 
1 erm | 
G(s) = <= —e 5s ee 


Take the Laplace transform of the equation: 
1 
s’Y(s) + 4Y(s) = a es—, 
i a eC ee [i 
s2(s2 + 4) s2(s24+4) s2 st +4 se g2 +4)" 
Using the shift formula (4.2.4), we conclude that 


Y(s) = 


rote zt 2 sin 2t — u,(t) [50 aie zsin a(t — J. 
Ry 
y = a(t) 
41 


1 


The ramp function y = g(t). 


4.3 The Delta Function and Impulse Forces 


Imagine a rod so thin that we may consider it to be one dimensional and so long that 
we assume it to extend for —co < t < o, along the t-axis. Assume that the function 
p(t) gives the density of the rod (weight per unit length). If we subdivide the interval 
(—N,N), for some N > 0, using the points f,, ty,...,t,, at a distance At = - apart, 
then the weight of the piece i can be approximated by p(t;)At, and ys p(t,)At gives 
an approximation of the total weight. Passing to the limit, letting At — 0 and N > o, 
we get the exact value of the weight: 


n oe) 
w= ie 2 punt = Tes p(t) dt. 


Assume now that the rod is moved to a new position in the (ft, y)-plane, with each 
point (t, 0) moved to a point (t, f(t)), where f(t) is a given function. What is the work 
needed for this move? For the piece i, the work is approximated by f(t,)e(t;)At. The 
total work is then 


Work = [ p(t) f(t) dt. 


Assume now that the rod has unit weight, w = 1, and the entire weight is pushed 
into a single point t = 0. The resulting distribution of weight is called the delta distri- 
bution, or the delta function, and is denoted 6(t). In view of the discussion above, it has 
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the following properties: 
(i) 6(t) = 0, for t #0, 
(ii) fees d(t)dt = 1 (unit weight), 


(iii) fy, S(O) f(t) dt = f(0). 


The last formula holds, because work is expended only to move the weight 1 at 
t = 0, the distance of f(0). Observe that 6(t) is not a usual function, like the ones 
studied in calculus. (Ifa usual function is equal to zero, except at one point, its integral 
is zero, over any interval.) One can think of 5(t) as the limit of the following sequence 


of functions (a delta sequence): 
if-—e<t <e, 
0 for other ft, 


a 
fie) = | 


as € > 0. (Observe that as fiye(t) dt = 1.) 


Me 
Pes f(x) 
fe(x) A(x) 
fix) 
OO > X ———_+_6_6_}_ 60-0 > X 
The step function f(x). A delta sequence. 


For any number fo, the function 6(t — to) gives a translation of the delta function, 
with the unit weight concentrated at t = tg. Correspondingly, its properties are 


(i) d6(t — to) = 0, for t $ to, 
(ii) f°, S(t — to) dt = 1, 
(iii) f@., O(t — to) f(t) dt = f(t). 


Using the properties (i) and (iii), we compute the Laplace transform, for any tg > 
0, 


foe) 


£060 t0)) = | a(t terse = f d(t — ty)e~! dt = eo, 
0 


In particular, 
£(d(t)) = 1. 
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Figure 4.1. Spring’s response to an impulse force. 


Correspondingly, 
£71 (e-80) = 5(t ty), and L£7'(1) = (ft). 
For example, 


£71 (S22) =£71(1- 2) = 8-2. 


Other physical quantities may be concentrated at a single point. In the following 
example we consider forced vibrations of a spring, with the external force concentrated 
at t = 2. We say that an external impulse force is applied at t = 2. 


Example 4.3.1. Solve the initial value problem 
y” + 2y’+5y=6d(t-—2), y(0)=0, y’(0)=0. 
Applying the Laplace transform and then solving for Y(s) and completing the square, 
obtain 
(s? + 29 -+ 5)Y(s) = 6e~5, 


6e725 6 
Y as ee —2s_ 
(s) S+2s+5 ° (s+1)?2+4 
1 
(s+1)2+4 


By the shift formula £~+ ( 
(4.2.6), we conclude that 


) — o sin 2t, and using the second shift formula 


y(t) = 3u,(t)e~“- sin 2(t — 2). 


Before the time t = 2, the external force is zero. Coupled with zero initial con- 
ditions, this leaves the spring at rest for t < 2. The impulse force at t = 2 sets the 
spring in motion, but the vibrations quickly die down, because of the heavy damping; 
see Figure 4.1] for the graph of y(t). 
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4.4 Convolution and the Tautochrone Curve 


The problem 
y"+y=0, yO)=0, yO)=1 
has solution y = sint. If we now add a forcing term g(t) and consider 
y"+y=g), yO)=0, y'(0)=0, 


then the solution is ; 


y(t) = i sin(t — v)g(v)dv, (4.4.1) 
0 


as we saw in the section on convolution integrals. Motivated by this formula, we now 
define the concept of convolution of two functions f(t) and g(t): 


t 
fare [ F(t — v)g(v)av. 
0 


The result is a function of t, which is also denoted as (f * g)(t). The formula (4.4.1) 
can now be written as 


y(t) = sint * g(t). 
Here is another example of convolution: 


t t t ok ol 
tee = [@-vrd=t [ vdo- f daw F-F=5. 
f R R 3 4 12 


If you compute ft? » t, the answer is the same. More generally, for any two continuous 
functions f(t) and g(t) 


ge fafreg. 
Indeed, making a change of variables v > u, by letting u = t — v, we express 


iE 
gu fe [ a(t — v) f(v)dv 
0 
0 


ne | alu) —u) du 


t 
+A 
i [ se weed 
(0) 


= f * g. 
It turns out that the Laplace transform of a convolution is equal to the product of 
the Laplace transforms: 


£(f * g) = F(s)G(s). 
Indeed, 


co t 
L(f*g)= [ est [ f(t —v)g(v)dv dt = | e—* f(t — v)g(v)dv dt, 
0 0 D 


where the double integral on the right-hand side is taken over the region D of the tu- 
plane, which is an infinite wedge 0 < vu < tin the first quadrant. We now evaluate this 
double integral by using the reverse order of repeated integrations: 


| e~*' f(t — v)g(v)dv dt = [ . g(v) ( [ . e~* f(t — v) ar) dv. (4.4.2) 
D 0 v 
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For the integral in the brackets, we make a change of variables t — u, by letting u = 
t—v, 


7 e—*' f(t —v) dt = [ e~S(U+4) f(y) du = e~5YF(s), 
v 0 
and then the right-hand side of is equal to F(s)G(s). 


U 
A 


The infinite wedge D. 


We obtained a useful formula: 
£7 (F(s)G(s)) = (f * g)(t). 


For example, 


s? : 
i> [te = cos 2t * cos 2t = i cos 2(t — v) cos 2udv. 
(s2 + 4)2 A 
Using that 
cos 2(t — v) = cos 2t cos 2u + sin 2t sin 2v, 


we conclude 


‘ t t 
Lot (i) = COS 2 | cos? 2udv + sin 2 [ sin 2u cos 2udu 
(s? + 4) 5 p 


1 1 
= ~—tcos2t + — sin 2t. 
2 = 4 


Example 4.4.1. Consider the vibrations of a spring at resonance 
y" +y =-3 cost, y(0) =0, y’(0) =0. 


Taking the Laplace transform, compute 


S 


1 RY Fi : 
- —., we invert it as 
S241 s241 


Writing Y(s) = —3 


3 
y(t) = —3sint * cost = —5ésint, 
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because 


t 
sint * cost = [ sin(t — v) cos udu 
0 


t 


i. [sin t cos v — cost sin v] cos vdu 
0 


Il 


ll 


t t 
sin t [ cos? vdv — cost [ sin v cos udu 
0 0 


Il 


Dit: : sin 2t sin t E ostsin’ ¢ 
2 4 2 


II 


Sp siat 
5 : 


We see again that the amplitude of oscillations, which is =t, tends to infinity with 
time t. 


4.4.1 The Tautochrone curve. Assume that we have a curve through the origin 
in the first quadrant of the xy-plane and a particle slides down this curve, under the in- 
fluence of the force of gravity. The initial velocity at the starting point is assumed to be 
zero. We wish to find the curve so that the time T it takes to reach the bottom at (0, 0) 
is the same, for any starting point (x, y). This historic curve, called the tautochrone 
(which means loosely “the same time” in Latin), was found by Christian Huygens in 
1673. He was motivated by the construction of a clock pendulum with the period in- 
dependent of its amplitude. 

Let (x1, v) be any intermediate position of the particle, v < y. Let s = f(v) be the 
length of the curve from (0,0) to (x;,v). Of course, the length s depends also on the 
time t, and = gives the speed of the particle. The kinetic energy of the particle at (x), v) 
is due to the decrease of its potential energy (m is the mass of the particle): 


14(#) - (y-v) 
5m|\ =) = mg(y — v). 


ds ds du 
By the chain rule, a an = f' ws, so that 


2 
s(roG) =s0-», 
FOF =-vV28Vy—0 


(minus, because the function v(t) is decreasing, while f’(v) > 0). We separate the 
variables and integrate: 


ef) . 
dv = 2g dt = 2gT. 4.4.3 
0 o= V 2g dt = 2g (4.4.3) 


(Over the time interval (0, T), the particle descends from v = y to v = 0.) To find the 
function f’, we need to solve the integral equation (4.4.3), which may be written as 


yl? « f(y) = 4/22 T. (4.4.4) 
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The Tautochrone curve. 


1 
Recall that in the Problems we had the formula £ (3) = Jz , or in terms of the 


variable y 
1 
L (v2) =/%. (4.4.5) 


Now apply the Laplace transform to the equation and get 


|Z (f'Q)) = V2ET=. 


Solving for £ (f’(y)) gives 


eon = ya) = Va), 


T2 : ‘ 
where we denoted a = 3 28: Using (4.4.5) again, 


f'y) = Vay? (4.4.6) 
2 
We have ds = dx? + dy, and so f’(y) = < =,/1+ (=) . Use this expression in 
y y 
(4.4.6), 
2 
ba (=) =ya—. (4.4.7) 
y) NO 


This is a first-order differential equation. One could solve it for = and then separate 


the variables. But it appears easier to use the parametric integration technique. To do 
that, we solve this equation for y, 


y=—: (4.4.8) 
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and set 
dx _ 1+ cos@ 
Se 4.4.9 
dy sin 0 ( ) 
where @ is a parameter. Using in (4.4.8), express 
sin” sin.@  _ al—cos?@_a 


ag SE = F1 - c088). 
sin’ 0+(1+coséy 2+2c086 2 1+c0sd gr ROBE) 


It follows that dy = ; sin 6d0. Then from (4.4.9), we get 


1+cosé a 
dx = i" 7- dy = 5 + cos 6)dé. 
Compute x by integration, obtaining 
x= 5(6 + sin 8), y= = (1 — cos 6), 
which is a parametric representation of the tautochrone. The name of this curve is 
cycloid, and it appears in many other applications. 


4.5 Distributions 


A function f(t) converts a number t into a number f(t). (Sometimes we do not use all 
real t but restrict f(t) to a smaller domain.) Functionals convert functions into num- 
bers. We shall allow only “nice” functions to be plugged into functionals. 

A function g(t), defined on the interval (—oo, 00), is said to be of compact support if 
it is equal to zero outside of some bounded interval (a, b). Functions that are infinitely 
differentiable on (—oo, oo), and of compact support, are called test functions. We shall 
reserve writing y(t) exclusively for test functions. 


Definition. Distribution is a linear functional on test functions. Notation: (f,g). (A 
test function g(t) goes in; the number (f, ¢) is the output. One usually also assumes 
(f, p) to be continuous in ¢, but we do not need that in a brief presentation.) 


Example 4.5.1. Let f(t) be any continuous function. Define the distribution 


(f.9) = [ Flp(t) dt. (4.5.1) 


Convergence is not a problem here, because the integrand vanishes outside of some 
bounded interval. This functional is linear, because 


Ger teen [ FOC Hexen) at 


2% [ fp dt +c, [ f(g, dt 
= ¢(f,91) + o(f, G2), 


for any two constants c, and c, and any two test functions ¢,(t) and ¢,(t). This way 
“usual” functions can be viewed as distributions. The formula (4.5.1) lets us consider 
{@) in the sense of distributions. 


166 Chapter 4. The Laplace Transform 


Example 4.5.2 (The Delta distribution). Define 


(6(¢), p) = (0). 


(Compare this with and the intuitive formula Je d(t)p(t) dt = g(0) from Sec- 
tion f.3,) We see that in the realm of distributions the delta function 6(t) sits next to 
usual functions, as an equal member of the club. 

Assume that f(t) is a differentiable function. Viewing f’(t) as a distribution, we 
have 


(f'.9) = ‘ fi(o( dt = i fiat = -(f.9"). 


using integration by parts (recall that g(t) is zero outside of some bounded interval). 
Motivated by this formula, we now define the derivative of any distribution f: 


(f'.9) =—-(f, 9’). 
In particular, 
(5', p) = —(6, 9’) = —¢'(0). 


(So 6’ is another distribution. We know how it acts on test functions.) Similarly, 
(6”",~) = —(6’, 9’) = y" (0), and in general 


(5, 9) = (-1)"p™(0). 
We see that all distributions are infinitely differentiable! In particular, all continuous 


functions are infinitely differentiable, if we view them as distributions. 


Example 4.5.3. The Heaviside function 


0 if-w<t<0O, 


a F ift>0 


has a jump at ¢ = 0. Clearly, H(t) is not differentiable at t = 0. But, in the sense of 
distributions, we claim that 


H'(t) = A(t). 
Indeed, 


(A"(t), ) = (A), ¢') = -| g(t) dt = g(0) = (6(¢), ¢). 
0 


Example 4.5.4. The function |t| is not differentiable at t = 0. But, in the sense of 
distributions, 


|t|’ = 2H(t) -1. 
Indeed, 


10) (oe) 
(It,9) = Ut. @) =— i (—1)e'(t) at — [ to! (t) at. 
roe) 0) 


Integrating by parts in both integrals, we continue: 


0 fore) 
(It!'.9) = — i o(t) dt + if g(t) dt = QH(t)—1,9). 
—C 0 
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4.5.1 Problems. 


I. Find the Laplace transform of the following functions. 


1. 54203 —e-*, 


10. 


12 1 


5 
Answer. - + —— —. 
Ss 


s4 S+4 


. 2sin3t— 0. 


Answer. 


S249 st? 


. cosh 2t — e*. 


. e cos 3t. 


s—2 
Answer. —————. 
(s—2)2+9 
3-3t 
ae 


2 
Answer. = — 

s3 
e73t 4, 


Answer. —— 
(s+3)5 


. sin? 2t. 


Ss 
Answer. 


. Sin 2t cos 2t. 


Answer. ——. 
s2+16 


sinh t cosh t. 


1 
Answer. —. 
2-4 


2s 2(s2+16)° 
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2e775 +2s— 
Answer, = —**5* 
s2 
Hint. Split the integral into two pieces. 


12. f(t) =t for 1 <t <3,and f(t) = 0 for all other t > 0. 


eS(s+1) ee 35(35+1) 
s s2 : 


Answer. F(s) = 


II. Find the inverse Laplace transform of the following functions. 


Answer. cosh 3t — 2e7*!. 


1 


s2+s° 


Answer. 1—e7!. 


S+s° 
Answer. 1 —cost. 


1 
* (s2-41)(s2+4)" 


1, A. 
Answer. 5 sint — = sin 2t. 


s 
s4455244° 


1 1 
Answer. : cost — - cos 2t. 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18.* 


1 
s242s+10° 


1% he, 
Answer. 5e ‘ sin 3t. 


1 
s245—2° 


1 1 
Answer. 5e Pee 2b 


Ss 


s2+s+1° 
1 

=< 3 1. v3 

Answer. e 2 |COos v3, — sin v3, : 
2 v3 2 
s-1 

s2-s—2° 

1 oat, 2,-+t 


Answer. ae 5¢ 


S+3 
45241" 
1 £23. t 
Answer. — cos - + = sin -. 
4 ana) 2 
S 
4s2—4s+5° 
1 


wal Tes 
Answer. e2 (- cost + : sin t). 


S+2 

53352425" 

Answer. 1 — 3e! + 2e. 
ss 


s445s244° 
2 5 
Answer. a cost + 3 Cos 2t. 


s242 
53252425" 


Answer. 1 + 2e! sint. 


(i) Consider _ where q(s) = (s—s,)(S—S) --- (s—s,,) with some numbers 


$1, S2,..., 8, and p(s) isa polynomial of degree less than n. By the method 
of partial fractions 


Ss a a a 
P(s) =. a? Ty ee ay (4.5.2) 
qs) S—-S, S—Sp S—Sp, 
for some numbers aj, d3,...,a,,. Show that a, = ee, and derive simi- 
q'(s1 


lar formulas for the other a;’s. 
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Hint. Multiply by s—s,, take the limit as s > s,, and use l’H6pital’s 
rule. 


(ii) Show that 


£71 (22) x . P(S;) esit. 


isl q'(s;) 
2 
(iii) Calculate £-! ||. 
(s—1)(s—2)(s—3) 


Answer. y = 3e! — 9e7" + 7e%!, 


Il. Using the Laplace transform, solve the following initial value problems. 


1. 


y” + 3y’ + 2y = 0, y(0) = —-1, y'(0) = 2. 


Answer. y = —e77!, 


. yy” +2y' + 5y =0, y(0) = 1, y'(0) = —2. 


Answer. ~e! (2 cos 2t — sin 2t). 


. y”+y=sin2t, y(0) = 0, y’(0) = 1. 


a2 des 
Answer. y = 3 Sint — 7 sin 2t. 


i oy + Oy =e", (0) =0, 7/0) =1. 


1 i , 
Answer. y = = - =e (cost — 3sint). 


_y” —y =0, y(0) =0, y'(0) =1, y”(0) =0, y"(0) = 0. 


Answer. y = ; sint + ; sinh t. 


. y = 16y = 0, y(0) = 0, y'(0) = 2; y" (0) = 0, y(0) = 8. 


Answer. y = sinh 2t. 


. y" + 3y" + 2y" =0, y(0) =0, y'(0) = 0, y"() = 1. 


e72t 


1 = 
Answer. y= —> — — +e - 


_ y” + 3y" +3y’ +y =e, y(0) =0, y'(0) =0, y’(0) = 0. 


Bet 


Answer. y = P 


(a) Let s > 0. Show that 


i a 
2. 
e* dx =,/—-. 
—0co Ss 
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Hint. Denote I = i e~** dx, Then 


P= i) eo sx? ax [ e7sy” dy= i, | e507 +") A. 


This is a double integral over the entire xy-plane. Evaluate it by using 
the polar coordinates, to obtain I 2=2. 
Ss 


1 
(b) Show that £ (3) = J 


1 


1 
Hint. £ (3) =f, t 2e~* dt. Make a change of variables t > x, by 


1 


1 
letting x = t2. Then £ (3) =o e-* dx = fn p88 ap J= 
Ss 


oo sinx 


2. Show that fh 


TT 
dx = -. 
2 


sin 


Hint. Consider f(t) = 1 ue dx, and calculate its Laplace transform F(s) = 


a1 


25° 


x 


3. Solve the following system of differential equations: 


dx 

ai =2x—y, x(0)=4, 
dy _ _ 
aoe 2y, y(0) = —2. 


Answer. x(t) = e + 3e*", y(t) = e! — 3e*!, 


4. Solve the following nonhomogeneous system of differential equations: 
x’ =2x-—3y+t, x(0)=0, 
y =-2x+y, y(0)=1. 
Answer. x(t) = e~! — — ett + =(-7 + 4t), y(t) =e"! + =e + -(-3 + 4t). 
V. 1. Afunction f(t) is equal to1 for 1 < t < 5andto0 forall other t > 0. Represent 
f(@) as a difference of two step functions, and find its Laplace transform. 


ens 


Answer. f(t) =u,(t)—u,(t), F(s) = — a 


= 
2. A function g(t) is equal to 1 for 0 < t < 5 and to —2 for t > 5. Represent g(t) 


using step functions, and find its Laplace transform. 


e755 


Answer. g(t) =1—3us(t), G(s) = = - 3— 
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10. 


11. 


12. 


13. 


. Find the inverse Laplace transform of e 


. Find the inverse Laplace transform of e~ 
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. A function h(t) is equal to —2 for 0 < t < 3, to4 for 3 < t < 7, and to 0 for 


t > 7. Represent h(t) using step functions, and find its Laplace transform. 


3s —7s 
Answer. h(t) = —2 + 6u3(t) — 4u,(t), H(s) = a eG a, 
Ss KY 


Ss 


. A function k(t) is equal to t for0 < t < 4.and to 4 fort > 4. Represent k(t) 


using step functions, and find its Laplace transform. 


—4s 
Answer. k(t) = t (1 — ug(t)) + 4u,(t) = t — uy(t) (t — 4), K(s) = 5 aneamiy by 
using the second shift formula (4.2.5). 


2 


. Find the Laplace transform of t? — 2u,(t). 


e748 


Answer. F(s) = 5 —2 : 


. Sketch the graph of the function u,(t) — 2u3(t) + 4u¢(t), and find its Laplace 


transform. 


. Find the inverse Laplace transform of = (2e~5 — 3e~45), 
S 


Answer. 2u,(t)(t — 1) — 3u,(t)(t — 4). 


= 95 3s-1 
244° 


Answer. u(t) [3 cos 2(t — 2) — : sin 2(t — 2)]. 


Ss 
s2+5—6 


a oe 
Answer. uy (t) (=e 2 =e acs 


TT 
Find the inverse Laplace transform of e 2° =o and simplify the answer. 
S 


S242, 
1 ; 
Answer. — sUnja(tje 7? sin 2t. 


Solve 
y" +y =4u,(t)—us(t), yO) = 2, y'(0) =0. 


Answer. 2 cost + 4u,(t) [1 — cos(t — 1)] — us(t) [1 — cos(t — 5)]. 


Solve 
y" + 3y’ +2y = un(t), yO) =0, y'(0) = -1. 


Answer. y(t) = e~7* —e* + u(t) [; wg A) wet). 


Solve 
y" +4y =u,(t)sint, y(0)=—1, y'(0) =1. 
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14. 


. Find the inverse Laplace transform of 


Hint. Write sint = — sin(t — zz), and use the shift formula (4.2.5). 
Answer. y(t) = —cos2t + ; sin 2t + u,,(t) (; sint + - sin 2t). 


Solve 

y"+y=g), yO)=0, y'(0)=0, 
where 
t if0<t<z, 


ax ift>7z. 


«=| 


Answer. y(t) =t—sint —u,(t)(t-—2+sint). 


. Show that £ (u(t) = £ (6(t—c)),c > 0. 


This formula shows that u;(t) = d(t — c). 


. Find the Laplace transform of 6(t — 4) — 2u,(t). 


. Find the inverse Laplace transform of a 
Ss 


Answer. 5(t) — 2e7*!. 


s*41 
s2425+2° 


Answer. 6(t) — e~'(2cost — sint). 


. Solve 


y"+y=<d(t—z), yO) =0, yO) =2. 


Answer. y(t) = 2sint —u,(t)sint. 


. Solve 
y" +2y'+10y = d(t—7), y(0) =0, y'(0) =0. 
Answer. y(t) = — uy (De-* sin 3f. 
. Solve 


4y"+y=6(t), yO) =0, y'(0) = 0. 


. 1 
Answer. y(t) = ~ sin 5 


. Solve 


dy" + 4y' + 5y = 6(t— 27), y(0) =0, y'(0) =1. 


1 (t-27) 


1 
<r : 1 - : 
Answer. y(t) =e 2‘ sint + zlan(te 2 sint. 


. Show that £ (d(t — to) f(t)) = e~*"° f(t) for any ty > 0. 
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10. Solve r 
y" +4y = 5(t = 5) cos t, y(0) =0, y'(0) =0. 


Answer. y(t) = =U /3(t) sin 2(t — =) 


VII. 1. Show that sint * 1 = 1—cost. (Observe that sint « 1 # sint.) 
2. Show that f(t) * 6(¢) = f(o, for any f(t) 
(so that the delta function plays the role of unity for convolution). 
3. Find the convolution t » t. 


3 
Answer. ee 


4. Find the convolution t * sin at. 


at—sinat 
Answer. . 
a2 


5. Find the convolution cost * cost. 
Hint. cos(t — v) = costcosvu + sint sin v. 
1 ieee 
Answer. ae cost + 5 sint. 


6. Using convolutions, find the inverse Laplace transform of the following func- 


tions: 
1 
(a) s3(s24+1)° 
ia . t2 
Answer. = * Sint = a +cost—1. 
\———n 
( ) (s+1)(s2+9) 
et 1 Soc 
Answer. —— + — cos 3t + — sin 3t. 
10 10 10 
Ss 
c : 
©) (s2+1)2 


14:23 
Answer. 5fsint. 


1 
(s2+9)2° 


(d) 


Answer. = sin 3t — 3t cos 3t. 
54 54 


7. Solve the following initial value problem at resonance: 


y” + 9y = cos 3t, y(0)=0, y'(0) = 0. 


Answer. y(t) = =tsin 3t. 
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8. 


10. 


11. 


12. 


Vi. s1. 


. Let f(t) = | 


. Consider a family of functions f,(t) = 


Solve the initial value problem with a given forcing term g(t) 
y"+4y= g(t),  — y(0) = 0, -y'(0) = 0. 


Answer. y(t) = ~ Jo sin 2(t — v)g(v)dv. 


. Find f(t) given that 


1 


£tsfO)= aaa 


Answer. t —sint. 


Find the Laplace transform of f, e~“-®) cos vdv. 


AY 


= _ 
Answer. £ (e~') £ (cost) = PENCE 


Solve the following Volterra integral equation: 


t 
y(t) + i, (t — v)y(v)dv = cos 2t. 
0 


Answer. y(t) = -: cost + : cos 2t. 

By using the Laplace transform, calculate t * t * t. 
bP 

Answer. a 


Find the second derivative of |t| in the sense of distributions. 


Answer. 26(t). 


. Find f(t), such that (n is a positive integer) 


FPO = (0). 


0 ift <0, 
Answer. f(t) = n-1 
FO=) icy > 0. 
(n-1)! 
t? ift <0, 


+5 ift >0. 
Show that f’(t) = 2t + 5d(t). 


Hint. f(t) = t? + 5H(t). 


= , € > 0. Show that in the sense 
m(t2+€2) 
of distributions 

lim f.(0) = d(t). 

€> 


One refers to f-(t) as a delta sequence. (Other delta sequences can be found in 
the book of M. Renardy and R. C. Rogers [[25]].) 
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Hint. (frp) = f°, 22 at = s®, #2 az 


© 7(t2+e2) m(z2+1) 


+00 | aapyte= 90 = 6.9). 


5. (i) The function K(x, t) = . — 
TU 


a constant). Show that in the sense of distributions 


lim K(x, t) = d(x). 


x2 
e 4kt is known as the heat kernel (k > 0 is 


(ii) Conclude that 


1 
lim K(x, t) * f(x) = lim 
t-0 t-0 2A I ockt 


(iii) Show that the function K(x, ft) satisfies the heat equation 
K, = kKyx- 
(iv) Conclude that the function u(x, t) = K(x, t) * f(x) satisfies 
U, = kuy,, ulx,0) = f(x). 


ih e “me f(y) dy = FO). 


Linear Systems of 
Differential Equations 


We begin this chapter by solving systems of linear differential equations with constant 
coefficients, using the eigenvalues and eigenvectors of the corresponding coefficient 
matrices. Then we study the long-term properties of these systems and the notion of 
the exponential of a matrix. We develop the Floquet theory for systems with periodic 
coefficients and make an application to Massera’s theorem. We classify the pictures at 
the origin for 2 x 2 systems and discuss the controllability and observability of linear 
systems. 


5.1 The Case of Real Eigenvalues 


We begin by recalling the basic notions of matrix theory. 


5.1.1 Review of Vectors and Matrices. Recall that given two vectors 


ay by 
Cr=] a |, Co=| be 
a3 bs 
a, +b, 
we can add them as C} + C, = a,+b, |, or multiply by a constant x: 
a3 + b, 
xa, 
xC, =] xa, |. More generally, we can compute the linear combination 
XQ3 
X1 a, + Xb, 
XC) + X2C = X1a2 + Xb 7 
X1a3 + Xb; 


for any two constants x, and x3. 177 
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We shall be dealing only with the square matrices, like the 3 x 3 matrix 


Ay, AyQ 3 
A=] 4 42 23 |}. (5.1.1) 
43, 132 133 


We shall view A as a row of column vectors A = [ CC, GQ G |, where 


ay, aj2 a43 
Ch=] ay |, Go=] ayn |, C=] a: 
a3) a32 a33 
xy 
The product of a matrix A and of avector x =| x, | is defined as the vector 
x3 


AX = Ci X, + Cyx2 + C3X3. 


(This definition is equivalent to the more traditional one that you might have seen 
before.) We get 


Ay Xy + Ay2X2 + A43X3 
Ax = a21X1 + Az2X2 + 23X3 
C31 X1 + A32X2 + 33X3 


Two vectors C; and C, are called linearly dependent if one of them is a constant 
multiple of the other, so that C, = aC, for some number a. (The zero vector is linearly 
dependent with any other vector.) Linearly dependent vectors C; and C, go along the 
same line. If the vectors C,; and C, do not go along the same line, they are linearly 
independent. Three vectors Cj, C2, and C; are called linearly dependent if one of them 
is a linear combination of the others, e.g., if C3 = aC, + bC2, for some numbers a, b. 
This means that C; lies in the plane determined by C, and C, so that all three vectors 
lie in the same plane. If C,, C,, and C; do not lie in the same plane, they are linearly 
independent. 

A system of 3 equations with 3 unknowns 


1X1 + Ay2Xz + Ay3X3 = by 
91 X1 + Ag2X2q + A93X3 = b, (5.1.2) 


31 X1 + A32X7 + A33X3 = b3 


can be written in the matrix form 


Ax = b, 
by 

where A is the 3 x 3 matrix above,andb=J| b, | is the given vector of the right-hand 
bs 


sides. Recall that the system ($.1.2) has a unique solution for any vector b if and only 
if the columns of the matrix A are linearly independent. (In that case, the determinant 
|A| # 0 and the inverse matrix A“! exist.) 
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5.1.2 Linear First-Order Systems with Constant Coefficients. We wish to 
find the functions x,(t), x2(t), and x3(t) that solve the following system of equations, 
with given constant coefficients ay,,..., a33, 


X] = Ay X1 + AyQX2 + A43X3, 
X= Aq Xy + Ag2Xz + A433, (5.1.3) 


X3 = 31 Xy + 39Xz + A33X3, 
subject to the given initial conditions 
X1(to) =a, X2(to)=B, %3(to) =. 
We may write this system using matrix notation: 
x'=Ax, X(ty) =X, (5.1.4) 


x1 (t) 
where x(t) = | X,(t) | is the unknown vector function, A is the 3 x 3 matrix of 
X3(t) 
a 
the coefficients, and x9 = | {6 | is the vector of initial conditions. Indeed, on the left 
Y 
x; (¢) 
in (6.1.3) we have components of the vector x’(t) = | x(t) |, while on the right we 
x4(t) 
see the components of the vector Ax. 

Let us observe that given two vector functions y(t) and z(t), which are solutions 
of the system x’ = Ax, their linear combination c, y(t) + c,z(t) is also a solution of the 
same system, for any constants c, and c,. Our system of differential equations is linear, 
because it involves only linear combinations of the unknown functions. 

We now search for a solution of in the form 


x(t) = e4#€, (5.1.5) 


with a constant A and a vector &, with entries independent of t. Substituting this into 
(6.1.4), we have 
ActtE = A(e£), 
giving 
Agé=2E, 
so that if 2 is an eigenvalue of A and € is the corresponding eigenvector, then (6.1.5) 
gives us a solution of the problem (5.1.4). Observe that the same is true for any square 


nxn matrix A. Let A,, Az, and A; be the eigenvalues of our 3 x 3 matrix A. There are 
several cases to consider. 


Case 1. The eigenvalues of A are real and distinct. It is known from matrix theory that 
the corresponding eigenvectors €,, §, and &3 are then linearly independent. We know 
that e4'é,, et, and e43'€, are solutions of our system (6.1.4), so that their linear 
combination 


x(t) = cyehté, + cnetat é, + c,e43t £, (5.1.6) 
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also solves the system (6.1.4). We claim that gives the general solution of our 
system, meaning that it is possible to determine the constants c,, cy, and c; to satisfy 
any initial conditions: 

X(t) = cye@tok, + crer2!0E, + cze4340F, = Xp, (6.17) 
This is a system of three linear equations with three unknowns c,, c, and c3. The ma- 
trix of this system is nonsingular, because its columns, e+2'0&,, e42'0€,, and e43/0€,, are 
linearly independent (observe that these columns are constant multiples of the linearly 
independent vectors &,, &, and 3). Therefore, we can find a unique solution triple ¢,, 
é, and é3 of the system (6.1.7). Then x(t) = Ge""&, + Ge! é, + 3e73"E; is the desired 
solution of our initial value problem (6.1.4). 


Example 5.1.1. Solve the system 
el ie af =i 
x -| 12 |= (0) =| 5 |. 
This is a 2 x 2 system, so that there are only two terms in (6.1.6). We compute the 


eigenvalues 2, = 1 and the corresponding eigenvector €, = = and A, = 3, with 


1 
the corresponding eigenvector & = 1 


x)= | |+ac"| ; | 


} The general solution is then 


or in components 
x(t) = —c,e' + c,e**, 
x,(t) = cye’ + coe*". 
Turning to the initial conditions, 
x1(0) = -c) +c, = —1, 
x,(0) =c, +e =2. 
Calculate c; = 3/2, cy = 1/2. 


Answer. 
— 3 ot. Lost 
x,(t) = 5° + 5e 
— 3 ot, Lost 
x,(t) = 5¢ + 5e 
Case 2. The eigenvalue A; is double, A, = 2, 23 # A,; however, A, has two linearly 
independent eigenvectors &, and &,. Let €; denote again an eigenvector corresponding 
to A3. This vector cannot lie in the plane spanned by &, and &, and then the vectors &, 
&,, and &, are linearly independent. The general solution is given again by the formula 
(5.1.6), with A, replaced by A): 


x(t) = cetité, + cette, 4+ c3e73tE,. 
To satisfy the initial conditions, we get a linear system for c,, cz, and c3, 
cyehok, + cretiot, + cresl0&, = Xo, 
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which has a unique solution, because its matrix has linearly independent columns. 
(Linearly independent eigenvectors is the key here!) 


Example 5.1.2. Solve the system 


1 1 
1 |x, x(O)= 0 
o =A 


Expanding the determinant of A — AI in the first row, we write the characteristic equa- 
tion as 
(2—A)[(2-A??-1] -(2-A-1) +14+A-2=0, 
(2-A)Q —A)B-A)- 20 -A) =0, 
(1—A)[2-—A)(3 —-A)- 2] =0. 


The roots are 2, = 1,A, = 1,A3 = 4. We calculate that the double eigenvalue A, = 1 


—1 0 
has two linearly independent eigenvectors &, = 0 |andé, =| -1 |. The other 
1 1 
1 
eigenvalue 2; = 4 has the corresponding eigenvector &, =| 1 |. The general solution 
1 
is then 
-1 0 1 
x(t)=cet| O |+ce7| -1 |+ce,e%] 1 |, 
1 1 1 


or, in components, 


x,(t) = —c,e' + c3e*, 
x2(t) = —c,e" + c,e*, 


x;(t) = cye' + coe’ +c,e%. 


Using the initial conditions, calculate c) = —2,c, = —1, andc3 = —1. 


Answer. 


x,(t) = 2e' — e**, 
x,(t) = e' — e*, 


x3(t) = —3e' — e**. 


Proceeding similarly, we can solve the initial value problem for anynxn 
matrix A, provided that all of its eigenvalues are real and it has a full set of n linearly 
independent eigenvectors. Recall that if an n x n matrix A is symmetric (aj; = ajj, for 
alli and j), then all of its eigenvalues are real. The eigenvalues of a symmetric matrix 
may be repeated, but there is always a full set of n linearly independent eigenvectors, 
so that one can solve the initial value problem for any system with a symmetric 
matrix. 
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Case 3. The eigenvalue 2, has multiplicity two (A, is a double root of the characteristic 
equation, A, = 2,), Az # A,, but A, has only one linearly independent eigenvector 
€. The eigenvalue A, brings in only one solution e+‘. By analogy with the second- 
order equations, we try teté for the second solution. However, this vector function 
is a scalar multiple of the first solution, so that it is linearly dependent with it, at any 
t = to. We modify our guess: 


x(t) = te4té + ety, (5.1.8) 


and choose a vector 7, to obtain a second linearly independent solution. Substituting 


into our system and using that Ag = A,&, obtain 
mle 4 Ate’ + Ayet'n = AytettE + et! An, 
Cancelling a pair of terms and dividing by e+’, we simplify this to 
(A-A,Dy = &. (5.1.9) 


Even though the matrix A — A,I is singular (its determinant is zero), it can be shown 
(using the Jordan normal form) that the linear system always has a solution 7, 
called generalized eigenvector. We see from that 7 is not a multiple of €. Using 
this 7 in gives us the second linearly independent solution, corresponding tod = 
A,. (Observe that cn is not a generalized eigenvector for any constant c # 1, unlike the 
usual eigenvectors. If 7 is a generalized eigenvector, then so is n + cé, for any constant 


c.) 
Example 5.1.3. Solve the system 
x' = aa x 
“Lt 2” 


This matrix has a double eigenvalue 2; = A, = 2 and only one linearly independent 


1 1 
eigenvector € = oe } We have one solution: x,(t) = e?! | A } The system 


to determine the vector n = : takes the form 
2 


—m — 2 =1, 
+2 =-1. 


Discard the second equation, because it is a multiple of the first. The first equation has 
infinitely many solutions. But all we need is just one solution that is not a multiple of €. 
So we set 72 = 0, which gives 7} = —1. We computed the second linearly independent 


solution: 
1 -1 
— tp2t 2t 
X(t) = te | i |te pile 


The general solution is then 


xHeacqe - + Cy (te a + e# 7 )) 
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5.2 A Pair of Complex Conjugate Eigenvalues 


5.2.1 Complex-Valued and Real-Valued Solutions. Recall that one differ- 
entiates complex-valued functions much the same way as the real ones. For example, 


d it _ «it 
A es 
where i = /—1 is treated the same way as any other constant. Any complex-valued 
function f(t) can be written in the form f(t) = u(t)+iv(t), where u(t) and v(t) are real- 
valued functions. It follows by the definition of derivative that f’(t) = u'(t) + iv’(t). 
For example, using Euler’s formula, 
oe — £ (cost +isint) = —sint +icost = i(cost +isint) = ie!. 
Any complex-valued vector function x(t) can also be written as x(t) = u(t) + iv(t), 
where u(t) and v(t) are real-valued vector functions. Again, we have x’(t) = u'(t) + 
iv'(t). 
If x(t) = u(t) + iv(t) is a complex-valued solution of our system (5.1.4), then 
u'(t) + iv’(t) = A (u(t) + iv(t)). 


Equating the real and imaginary parts, we see that both u(t) and v(t) are real-valued 


solutions of our system (6.1.4). 


5.2.2 The General Solution. Assume that the matrix A has a pair of complex 
conjugate eigenvalues p + iq and p — iq. They need to contribute two linearly indepen- 
dent solutions. The eigenvector corresponding to p + iq is complex valued, which we 
may write as € + in, where & and 7 are real-valued vectors. Then x(t) = e@+!9*(E + in) 
is a solution of our system. To get two real-valued solutions, we take the real and the 
imaginary parts of this solution. Obtain 
x(t) = eP*(cos qt + isin qt)(é + in) 
= eP'(cos qt € — singt n) + ie?'(sin qt € + cosqt n), 

so that 

u(t) = eP*(cos qt € — sin qt n), 

v(t) = e?'(sin qt € + cos qt n) 
give us two real-valued solutions. In the case of a 2 x 2 matrix (when there are no other 
eigenvalues), the general solution is 


x(t) = cyu(t) + c,0(t). (5.2.1) 


(If one uses the other eigenvalue p — iq and the corresponding eigenvector, the answer 
is the same.) We show in the exercises that one can choose the constants c, and c, to 
satisfy any initial condition x(tp) = x9. 


Example 5.2.1. Solve the system 


v=| 3 [ |» xo)=| 7 |. 
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Calculate the eigenvalues 2; = 1+ 2i and A, = 1 — 2i. The eigenvector corresponding 


to A, is ‘ | so that we have a complex-valued solution e(1+2i)t : } Using Euler’s 


1 
formula, rewrite it as 


e(cos 2+ isin29| : |=«'| — sin 2t | cos 2¢ | 


cos 2t sin 2t 


The real and imaginary parts give us two linearly independent solutions, so that the 


general solution is 
qpeael sin 2t qe ee ee 2t 
= cos 2t 2 | sin Qe | 


In components, 
x,(t) = —c,e! sin 2t + cye! cos 2t, 
X2(t) = ce’ cos 2t + cre! sin 2¢. 
From the initial conditions 
X1(0) = ¢ = 2, 
x2(0) =c; =1, 


so that c} = 1 and c = 2. 


Answer. 
x,(t) = —e! sin 2t + 2e' cos 2t, 


x>(t) = e' cos 2t + 2e! sin 2t. 


Example 5.2.2. Solve the system 


2 -1 2 
eS 1 O 2 |x 
— 1-1 
0 
One calculates the eigenvalue A, = 1 and the corresponding eigenvector | 2 |. Oneof 
1 
0 
the solutions is then e’} 2 |. The other two eigenvalues are 2, = i and A, = —i. The 
1 
-1-i 
eigenvector corresponding tod, =iis} —1 —i |, giving us a complex-valued solution 
1 
-1-i 
e#| —1—-i |. We rewrite it as 
1 
-l1-i —cost + sint —cost —sint 
(cost +isint)]}| -—1—i |=] —cost+sint |+i] —cost—sint 


1 cost sin t 
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Taking its real and imaginary parts gives us two more linearly independent solutions, 
so that the general solution is 


0 —cost+sint —cost —sint 
x(t)=cye'| 2 |+c,]| —cost+sint |+c,;| —cost—sint 
1 cost sin t 


Examining the form of the solutions in all of the above cases, we see that ifall eigen- 
values of a matrix A are either negative or have negative real parts, then lim,_,,, x(t) = 0 
(all components of the vector x(t) tend to zero). 


5.2.3 Nonhomogeneous Systems. Similarly to the case of a single equation, 
the general solution of a nonhomogeneous system 


x’ =Ax+ f(t), 


with a given vector function f(t), is the sum of any particular solution Y(t) of this 
system and the general solution of the corresponding homogeneous system 


x’ = Ax. 
Sometimes one can guess the form of Y(t). 


Example 5.2.3. Solve the system 


A —t 
We look for a particular solution in the form Y(t) = Bet and calculate A = — =, 
pt 
B= -, so that Y(t) = , |: The general solution of the corresponding homoge- 
-e 
8 
neous system was found in the Example 
3 -t 
mae t| —1 3t| 1 
Answer. x(t) = ‘ +cye +c 2e : 
xe 1 1 
8 


Later on we shall develop the method of variation of parameters for nonhomoge- 
neous systems. 


5.3 The Exponential of a Matrix 


In matrix notation, a linear system with a square matrix A, 
x’ = Ax, x(0) = Xo, (5.3.1) 
looks like a single equation. In case A and x, are constants, the solution of (6.3.1) is 


x(t) = e4*x,. (5.3.2) 


186 Chapter 5. Linear Systems of Differential Equations 


In order to write the solution of our system in the form (6.3.2), we shall define the no- 
tion of the exponential of a matrix. First, we define powers of a matrix: A? = 
A-A, A? = A? -A, and so on, using repeated matrix multiplications. Starting with 
the Maclauren series 

x? x3 x4 — x 


Salen at gota =>) 


we define (J is the identity matrix) 


A A At At 
TIA beet A De 
3! > 2! 

n= 


so that e4 is the sum of infinitely many matrices and each entry of e4 is an infinite 
series. It can be shown that all of these series are convergent for any matrix A, so that 
we can compute e@ for any square matrix A (we shall prove this fact for diagonalizable 
matrices). If O denotes a square matrix with all entries equal to zero, then e° = I. 
Wee 242 343 444 
A’t At A’t 
eAt = 1+ At+ —— fe a a 

and then — ies 

a >, 4 Att <a 

ae SRA oe a +++ = AeA, 
We conclude by a direct substitution that the formula gives the solution of the 
initial value problem (§.3.1). (Observe that x(0) = e° x9 = Xp.) 


Example 5.3.1. LetA = ; ; | where aand bare constants. Then A” = 0 


and we have 
b2 3 
0 1+b+—+—+4+- 
23! 


Example 5.3.2. Let A = : e } Calculate: A2 = —I, A? = —A, A* = I. Then for 
any constant t 
a =| 1—¢7/2!40t4/4!4+--- -¢+03/3!-8/5!+--- |-| cost —sint | 
t—8/3!40/5!+--- 1—t7/2!4t4/4!14--- sint cost 
The last example lets us express the solution of the system 
XxX, =—Xz, x,(0) =a, 


xX, =%X, (0) = 8, 


x(t) = At] % cost —sint a 
Ee 5 | ex ek 


as : ere a : 
which is rotation of the initial vector | by the angle t, counterclockwise. We see 


(5.3.3) 


in the form 


B 


that the integral curves of our system are circles in the (x,, x2)-plane. This makes sense, 
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, 


‘ x —X, |. ‘ ss 

because the velocity vector a = - | is always perpendicular to the position 
2 1 

xy 

x2 

Observe that the system (5.3.3) is equivalent to the equation 


vector 


x{ +x, =0, 


modeling a harmonic oscillator. 
Recall that we can write a square matrix 


a1 Q12 
as a row of column vectors A = [C, C, C3], where C} = | ay, |,C, =| ay |, and 
a3) a32 
a13 xy 
C3 =] a3 |. Then the product of the matrix A and ofavectorx =| x, | is defined 
33 x3 


as the vector 
AX = CyX, + Cox. + C3X3. 


If B is another 3 x 3 matrix, whose columns are the vectors K,, K, and K3, we define 
the product of the matrices A and B as follows: 


AB = A[K, K> K3] = [AK, AK, AK3]. 


(This definition is equivalent to the traditional one, which is giving the ij-element of 
the product: (AB); = > 2, aj-b;;-) In general, AB # BA. 


A, 0 O 
Let A be a diagonal matrix A=| 0 A, O- |. Compute the product 
0 O A; 
Ay 0 0 
AA = A 0 A A, A 0) = [a,c A,C2 A3C3]| ’ 
0 0 A3 


so that multiplying a matrix A from the right by a diagonal matrix A results in the 
columns of A being multiplied by the corresponding entries of A. (Multiplication of a 
matrix A from the left by a diagonal matrix A results in the rows of A being multiplied 
by the corresponding entries of A.) 

Assume now that the matrix A has three linearly independent eigenvectors E,, E>, 
and £3, so that AE, = 1, £,, AE, = A,E,, and AE; = A3E; (the eigenvalues 2, A,, and 
A; are not necessarily different). Form a matrix S = [E, E, £3]. Observe that S has an 
inverse matrix S~!. Calculate 


AS => [AE AE, AE; | — [A Fy A,E A3E3| = SA. 
Multiplying both sides from the left by S~', obtain 
SAS =A. (5.3.4) 
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Similarly, 

A=SAS". (5.3.5) 
One refers to the formulas and (6.3.5) as giving the diagonalization of the matrix 
A. We see that any matrix with a full set of three linearly independent eigenvectors can 
be diagonalized. An nxn matrix A is diagonalizable if it has a complete set of n linearly 


independent eigenvectors. In particular, symmetric matrices are diagonalizable. 
If A is diagonalizable, so that the formula (6.3.5) holds, then 


A? = AA = SAS™!SAS7! = SA2S~!, 


and in general A” = SA"S~!. We then have (for any real scalar t) 


SAM SS SAners-l Ann 
a = fo -1l_ Ate-1 
ene De ai = 2a =5 2; Sot = Setis7h. 
n= n= tt 


The following important theorem holds for any n x n matrix. 


Theorem 5.3.1. Assume that all eigenvalues of the matrix A are either negative or have 
negative real parts. Then all solutions of the system 
x’ = Ax 


tend to zeroast — ov. 


We can prove this theorem in the case when A is diagonalizable. Indeed, then we 

have 

x(t) = e4'x(0) = SeA‘S-!x(0). 
The matrix e™ is a diagonal one, and its entries, e*"’, e%2', ..., en’, tend to zero ast > oo, 
so that x(t) > Oast > oo. 

In general, e4+® + e4e%. This is because AB # BA for matrices, in general. (One 
way to show that e*tY = e*e? is to expand all three exponentials in power series and 
show that the series on the left is the same as the one on the right. In the process, we 
use that xy = yx for numbers.) But e“+4 = ee4, because (aI)A = A(al) (a is any 


2 ot Jimena = 21+] a fs ana we have 


number). For example, if A = | 1 5 1 0 


feo 
eAt — pte | 0 


= cost —sint 
~ sint cost 


_[ e% 0 ]f[ cost —sint 
~ 0 et sint cost 


= ptt cost —sint 
~ sint cost |* 


Nonhomogeneous Systems. We shall solve the initial value problem 


x’ =Ax+ f(t), x(to) = Xo, (5.3.6) 
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where f(t) is a given vector function and A is a constant square matrix. The solution is 


t 

x(t) = eA@-to) x, + eAt i) e~As f(s) ds. (5.3.7) 
to 

How does one think of this formula? In case of one equation (when A is a number) we 

have an easy linear equation (with the integrating factor 1 = e~4"), for which (6.3.7) 

gives the solution. We use that < eA(t-to) = Ae4(—‘o) to justify this formula for matri- 

ces. 


Example 5.3.3. Solve 


By 63.7) 
We have 
cost —sint 
At = . 
sint cost 
o-AS = coss sins 
~ 1 —sins coss 
en As 1] _ coss sins 1] _ cos s + ssins 
s | | —sins coss s | | -—sins+scoss |° 
Then 


fe| 1 |as= fy (Coss + ssins)ds -| —tcost + 2sint r 
0 Ss Jo (— sins + scoss) ds —2+2cost+tsint 


t . 
At [ o-As 1 dee —t+2sint 
a Ss 2 —2cost 


We conclude that 
x(t) = —3sint —t+2sint |_| —t—sint 
7 3cost 2-—2cost | | 2+cost |’ 
or, in components, x,(t) = —t — sint, x,(t) = 2+ cost. 


An easier approach for this particular system is to convert it to a single equation 
Xi +x, =—t, x,(0) =0, x{(0) = -2, 
with the solution x,(t) = —t — sint, and then x, = —x} +1=2+4 cost. 
5.3.1 Problems. 


I. Solve the following systems of differential equations. 
,_f1 -2 
1x = a, 2a |= 


Answer. x(t) = c,e~*# : + Cy : } 
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cost — sint cost + sint 
Answer. x(t) = c, 7 


2cost 2sint 
2 1éii1 
x =} 12 1 |x 
} I 2 
1 —l —l 
Answer. x(t)=c,e**| 1 |+ce'| 0 | +c3e! 1 
1 1 0 


eS ee | x. Check your answer by reducing this system to a first-order 


0 3 
equation for x,(t). 


1 
Answer. x(t) = c,e*! | 6 + ce! (: 


or 
a) 
+ 
—— 
HO 
a 
“—_— 


-1 0 0 
C= 0 2 1 |x 
0 0 2 
1 0 
Answer. x(t) =cye"*| 0 | +c,e4] 1 |+cz,e/ rt] 1 [+] 0 
0 0 1 
fe 1 7 1 
v=|3 ae o=| 5 | 
Answer. 


X,(t) = 2e7# — et, 


X,(t) = —2e*4 — et, 


x= ae Js x(0) = | : | check your answer by reducing this system 


1 0 
to a second-order equation for x, (ft). 
Answer. 
ee ee 
x,(t) = 5° + o> 


1 3 
x,(t) = =5e" + 5c. 


0 
.x’=] -2 3 2 |x, xO)=] 1 
5 2 
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Answer. 
x,(t) = —3e' — 2c! + 5e%, 
X(t) = —4e*! + 5e3", 
x;(t) = —3e’ + 5e*. 
4 0 1 —2 
9.x'=}] —2 1 0]x, xO)= 5 
—2 0 1 0 
Answer. 
x1(t) = 2e”! — 4e3!, 
X,(t) = Se’ — 4e7! + 4e%, 
x3(t) = —4e”! + 4e3¢, 
2.0 al —2 
10. x’=] 1 2 1 ]x, xO)= 3 
1 1 2 2 
Answer. 
x,(t) = —3e! + e*, 
X(t) = 2e! + eft 
x;(t) =e’ +e%. 
1 4 0 —2 
ll. x'=] -4 -7 0 |x, x(0)= 6 
0 0 5 1 
Answer. 


x,(t) = 2e734(—1 + 81), 
x,(t) = —2e734(—3 + 81), 
x(t) = er". 
; G: 23 =3 
12. x’ = * 6 |= x(0) = 1 | Check your answer by reducing this 


system to a second-order equation for x,(t). 


Answer. 
x,(t) = —2 cos 2t — sin 2t, 
xX,(t) = cos 2t — 2sin2t. 


13. x =| ; es J» (0) =| : |. 
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14. 


15. 


16. 


17. 
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Answer. 
x,(t) = —e* sin 2t, 
x,(t) = e*! cos 2t. 
1 2 2 —1 
x’ =} -1 1 #O fx, x(0O)= 1 
0 —2 -1 2 
Answer. 
x,(t) = —cost + 5sint, 
x(t) = —e' + 2cost + 3sint, 
x3(t) = e' + cost —5sint. 
0 -3 O 1 
x =| 3 0 4 |x, xO0)=] 0 
0 -4 0 3 
Answer. 


x,(t) = : (9 cos 5t — 4), 
x,(t) = 3sin5t, 


X3(t) = = (4cos 5t+1). 


Solve the second-order system 


Hint. The system 

x” = Ax (5.3.8) 
has a solution of the form x = e“é, provided that /? is an eigenvalue of A and 
E is the corresponding eigenvector. If 2, > 0 and A, > 0 are the eigenvalues 
of a 2 x 2 matrix A with the corresponding eigenvectors &, and &, then the 


general solution of is 
x = ce VATE, + cyeVULE, + cze-V424E, + cyeV2tE,, 


—1 —1 —2 —2 
= —2t 2t —t t 
Answer. x = ce 1 [exe | 1 |e 5 [tae 5 } 


(i) Solve the second-order system 


gil PF 1s 
“14 047 


Hint. If the matrix A has a negative eigenvalue 2 = — p*, corresponding 
to an eigenvector €, then x = cos pté and x = sin pté are solutions of 


the system (6.3.8). 
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18. 


19. 


I. 1. 


4. 


Answer. 


1 1 1 1 
Sn =2t 2t : 
x=cje | [tee | [+escos2e] 1 ] +eesin2r] 1 I 


(ii) Verify the answer by converting this system to a single equation: 
x{" — 16x, = 0. 


Solve the nonhomogeneous system 
x' = eee x+ S 
13 4 —5e |° 
Answer. x(t) = e! ze + cet = + ce | as } 


Solve the nonhomogeneous system 


re oa 


; : ete At+B 
Hint. Look for a particular solution in the form Y(t) = - . 
Ct+D 
t ; Logi: re oer : 
Answer. X; = = + 5e cost — 5° sint—1,x,= a + 5° (cost + 10sin f). 


Show that all solutions of the system x’ = a 


b F ye 
. x, with positive con- 
stants a and b, satisfy 


lim x,;(t)=0 and lim x,(t) = 0. 


. Write the equation (here b and c are constants, y = y(t)) 


y” + by’ +cy=0 
as a system of two first-order equations, by letting x,(t) = y(t), x(t) = y’(t). 
Compute the eigenvalues for the matrix of this system. Show that all solutions 
tend to zero, as t > oo, provided that b and c are positive constants. 


. Consider the system 


x} _ ax, + bx>, 
xX, = cx, + dx, 
with given constants a, b, c, and d. Assume that a+ d < 0 and ad — bc > 0. 


Show that all solutions tend to zero, as t > oo (x,(t) > 0, and x,(t) > 0, as 
t > oo). 


Hint. Show that the eigenvalues for the matrix of this system are either neg- 
ative or have negative real parts. 


(i) Let A be a 3 x 3 constant matrix. Suppose that all solutions of x’ = Ax 
are bounded as t > +00 and as t > —oo. Show that every solution is 
periodic and there is a common period for all solutions. 
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Hint. One of the eigenvalues of A must be zero and the other two purely 
imaginary. 


(ii) Assume that a constant 3 x 3 matrix A is skew-symmetric, which means 
that AT = —A. Show that one of the eigenvalues of A is zero and the 
other two are purely imaginary. 


Hint. Observe that aj; = —aj;;, aj; = 0, and then calculate the charac- 
teristic polynomial. 


Let x(t) and y(t) be two solutions of the system 

x’ = Ax, 
with an n X n matrix A. Show that 5x(t) and x(t) + y(t) are also solutions. 
Show that the same is true for c, x(t) + c2y(t), with any numbers c, and c3. 
Are the above conclusions true if the entries of A depend on t? 

(i) Suppose that p + iq is an eigenvalue of A and & + in is a corresponding 
eigenvector. Show that p — iq is also an eigenvalue of A and  —inisa 
corresponding eigenvector. (A is an n x n matrix with real entries.) 

(ii) Show that & and 7 are linearly independent. (There is no complex num- 
ber c, such that y = cé.) 


Hint. Linear dependence of € and n would imply linear dependence of 
the eigenvectors € + in and & — in. 


(iii) Show that the formula (6.2.1) gives the general solution of the 2 x 2 
system x’ = Ax, so that we can choose c, and cy, with x(to) = Xo, for 
any initial condition. 


Hint. Decompose xp as a linear combination of € and 7, and then find 
c, and cp. 


7. Consider the following system with a nonconstant matrix: 


3 3 : 
—1+==cos*t 1—-costsint 
x = 2 2 x. 


-1- = costsint —1+ = sin” t 


; ‘ 1 ; : 
Show that the eigenvalues of the matrix are —;+ ui i, yet it has an unbounded 


solution x(t) = ei =n 
~ sint 
This example shows that for systems with variable coefficients 
x’ = A(t)x 


the assumption that the eigenvalues of A(t) are either negative or have nega- 
tive real parts does not imply that all solutions tend to zero (not even if A(t) is 
a periodic matrix). 


Hint. To compute the eigenvalues, calculate the trace and the determinant of 
A(t). 
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Ill 1. LetA= ee . Show that 
0 O 
1 t 
t_ 
eA -| oe I 
0 1 0 
2. LetA=] 0 O 1 J. Show that 
0 0 0 
ae: ~t? 
eS ae ot 
0 0 1 
—3 1 0 
3. LetA = 0 -3 1 |. Show that 
0 0 -3 
do°¥ ~t? 
eet! Oo: ag 
0 0 1 
0 -1 0O 
4. LettA=]| 1 0 O |. Show that 
0 0 2 
cost —sint 0 
e4t=]| sint cost 0 
0 0 e 
3 -1 0 
5. LetA=] 1 3 0 |. Show that 
0 0 2 
e£cost -e*sint 0 
et=|] etsint e*cost 0 
0 0 ef 
0 -1 0 
6. LetA=]| 0 0 0 |. Show that 
0 Oo —2 
1 -t O 
et=1 0 1 0 
0 O e 
7. Leta =| : ; | show that 


; _| cosht sinht 
are sinht cosht 
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8. 


10. 


11. 


12. 


13. 


14. 


15. 


16. 
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Consider 
—2 1 0 0 
0 -—2 1 0 
= 0 o 2 177 
0 0 0 -—2 
a Jordan block. Show that 
1 ¢ +2 128 
2 3! 
112 
elt et} O 1 t Gt 
00 1 t 
00 O 1 


Show that the series for e4 converges for any diagonalizable matrix A. 
Hint. If A= SAS™, then e4 = Se4s7}. 


Show that for any square matrix A, 
Ae“! = eAtA, 
Is it true that A?e4! = e44A?? 
Show that for any square matrix A and any constants ¢ and s, 


eAt As = eASPAt — eA(t+s) 


Two square matrices of the same size, A and B, are said to commute if AB = 
BA. Show that then 
eAeB = cAtB, 


Show that for any n x n matrix A 
(e4) =e%, 
Show that for any positive integer m 
(eA) = em, 


Let A be a square matrix. Show that all entries of e4! are nonnegative for t > 0 
if and only if 
ajj 20, for alli # j. (5.3.9) 


Hint. For small t, e4t ~ I + At, so that if all entries of e4' are nonnegative, 
then holds. The same formula also shows that if holds, then all 
entries of e4! are nonnegative, if t > 0 is small. To see that the same is true 


for all t > 0, write 
t m 
eAt — Can ; 


for any integer m > 0, and observe that the product of two matrices with all 
entries nonnegative has all entries nonnegative. 


Show that 
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17. (i) Let A be an eigenvalue of a square matrix A, corresponding to an eigen- 
vector x. Show that e“ has an eigenvalue e*, corresponding to the same 
eigenvector x. 


Hint. If Ax = Ax, then 


(ii) Show that there is no 2 x 2 matrix A with real entries, such that 
-1 0 
Oo -2 |° 


(iii) Show that the determinant |e“| of the matrix e4 is positive, so that e4 
is nonsingular. 


5.4 Floquet Theory and Massera’s Theorem 


Logs of Negative Numbers and Logs of Matrices. We wish to give a meaning to 
the natural logarithm In(—2). We regard —2 as a complex number —2 + Oi. Writing it 
in the polar form —2 = 2e!7 = 2e!(7+27™) where m is any integer, suggests that 


In(—2) = In2+i(7+2am), m=0,+1,+2.,.... 
Ifz=rel® # 0 is any complex number, we define 
Inz=Inr+i(@+27m), m=0,+1,+2,.... 


Observe that In z is a multivalued function. 
Given any nonsingular square matrix C (so that the determinant |C| = det C ¥ 0), 
it is known that one can find a square matrix B, such that e® =. Itis natural to write 


B=1nC. For example, 
ia cost —sint |_| 0 —t 
sint cost | | t O]° 


In case C is a diagonal matrix, just take the logs of the diagonal entries, to compute 
In C. If C is diagonalizable, so that C = SAS -! and the diagonal matrix A has nonzero 
entries, then In C = SInAS~!. Observe that the entries of In C are complex valued and 
that In C is not unique. For a general matrix C, one needs the Jordan normal form to 
compute In C, which is outside of the scope of this book. 


Linear Dependence and Independence of Vectors. Given n-dimensional vectors 
X1,X2,...,X_, we play the following game: choose the numbers c,, ¢3,..., Cc, so that 


CyXy + CQX_ +++ +CRX_, = Oz (5.4.1) 


There is an easy way to “win”: take all c; = 0. We declare this way to be illegal (like 
off-side in soccer, or false start in football). If we can choose the constants so that at 
least one of them is not zero and holds, we call the vectors x1, X2,...,X; linearly 
dependent. Otherwise, if the only way to make hold is by “cheating”, or by taking 
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Cy = Cy = ++: = cx = O," then the vectors are called linearly independent. Assume that 
the vectors x1, X2,..., xX; are linearly dependent, and say c, # 0. Then from (6.4.1) 
c c 
ase au ee 
Cy Cy 


so that one of the vectors is a linear combination of the others. 
Recall that if the columns of an n xX n matrix A are linearly independent, then the 
determinant det A # 0 and the inverse matrix A~! exists. In such a case, the system 


Ax =b (5.4.2) 


is solvable for any vector b (x = A-'b). In case det A = 0, the system ((5.4.2) is solvable 
only for “lucky” b, which we describe next. Consider the system 


A™v =0, (5.4.3) 


where A? is the transpose matrix. In case detA = 0, the system is solvable if 
and only if (b, v) = 0, where v is any solution @.4.3). (Observe that det A? = det A = 0, 
so that has nonzero solutions.) This fact is known as the Fredholm alternative. 
Here (b, v) = b’ v is the scalar (inner) product. (The book by G. Strang [B2]] has more 
details.) 

Recall also that (Ax, y) = (x, A’ y) for any square matrix A and vectors x and y. 


The Fundamental Solution Matrix. We consider systems of the form (here x = x(t) 
is an n-dimensional vector) 

x’ = A(t)x (5.4.4) 
where the n Xn matrix A(t) depends on ft. Assume that the vectors x(t), x2(t), ...,X,(0) 
are linearly independent (at all ¢) solutions of this system. We use these vectors as 
columns of the matrix 

X(t) = [x (t) x2(t)... xn (OI. 
This 1 Xn matrix X(t) is called a fundamental solution matrix, or a fundamental matrix 
for short. If, moreover, X(0) = I (the identity matrix), we call X(t) the normalized 
fundamental matrix. We claim that the general solution of is 


x(t) = c,X,(t) + CoX2(t) +--+ +¢,x,(t) = X(t)ec, 


where c is the column vector c = [c),c3... Cal’ and the c;’s are arbitrary constants. In- 
deed, if y(t) is any solution of (6.4.4), we choose the vector cy, so that X(0)cy = y(0) 
(or cp = X~'(0)y(0)). Then the two solutions of (6.4.4), X(t)co and y(t), have the same 
initial values at t = 0. By the uniqueness of solution theorem (see the Theorem 
below), y(t) = X(t)co. 

Let Y(t) be another fundamental matrix Y(t) = [y,(t) y2(t)...y,(0)]. Its first col- 
umn y,(t) is a solution of (6.4.4), and so y,(t) = X(t)d,, where d, is a constant n- 
dimensional vector. Similarly, y,(t) = X(t)d,, and so on. Form an n xX n matrix 
D = [d,d,...d,], with constant entries. Then 


Y(t) = XD, (5.4.5) 


by the rules of matrix multiplication. Observe that the matrix D is nonsingular (det(Y(t)) 
= det(X(t)) det(D), and det(Y(t)) # 0). 
Observe that any fundamental matrix X satisfies the equation (6.4.4), so that 


X’ = A(DX. (5.4.6) 
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Indeed, the first column on the left, which is x}, is equal to the first column on the 
right, which is Ax, etc. 

We now develop the variation of parameters method for the nonhomogeneous sys- 
tem 


x’ = A(t)x + f(t). (5.4.7) 


Since X(t)c is the general solution of the corresponding homogeneous system (6.4.4), 
the general solution of (6.4.7) has the form 


x(t) = X(t)c + Y(), 


where Y(t) is any particular solution of (6.4.7). We search for Y(t) in the form x = 
X(t)c(t), with the appropriate vector function c(t). Substituting this into (6.4.7) and 


using (6.4.4), we see that c(t) must satisfy 
X(tHe'(t) = FO), 


so that c(t) = i X~1(s) f(s) ds, with arbitrary number fo. It follows that the general 
solution of is given by 


t 
x(t) = X(Hc + X(t) i: X71(s) f(s) ds. (5.4.8) 
to 


In case the matrix A of the system (5.4.4) has constant entries, one can use X(t) = e44 
as the fundamental solution matrix and recover the solution formula (6.3.7) above. 

If X(t) is the normalized fundamental matrix and fy = 0, then c = x(0), and 
becomes 


t 
x(t) = X(t)x(0) + X(t) i X—1(s) f(s) ds. (5.4.9) 
0 


Periodic Systems. We now consider n x n systems with periodic coefficients 
x'=A(t)x, with A(t+ p) = A(t). (5.4.10) 


We assume that all entries of the n x n matrix A(t) are functions of the period p. Any 
solution x(t) of (6.4.10) satisfies this system at all times t, in particular at the time t+ p, 
so that 


x'(t + p) = A(t + p)x(t + p), 
which implies that 
x'(t + p) = A(t)x(t + p). 
We conclude that x(t + p) is also a solution of (6.4.10). Let X(t) be a fundamental 
matrix of (§.4.10); then so is X(t + p), and by (6.4.5) 

X(t + p) = X(t)D, (5.4.11) 
with some nonsingular n x n matrix D, with constant entries. Let the matrix B be 
such that e8? = D, so that e~8P = D7! and B = - In D (the entries of B are complex 
numbers, in general). Define the matrix P(t) = X(t)e~8‘. Then X(t) = P(t)e?*. We 
claim that P(t + p) = P(t). Indeed, using (6.4.11), 

P(t + p) = X(t + p)eBUtP) = X(t)DE-3P et = x(te®! = P(t). 
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We have just derived the following Floquet theorem. 


Theorem 5.4.1. Any fundamental matrix of the system is of the form X(t) = 
P(t)e®*, where the matrix P(t) is p-periodic and B is a constant matrix. (The entries of B 
and P(t) are complex numbers, in general.) 


The eigenvalues (possibly complex) of the matrix D = e®? are called the Floquet 
multipliers. Assume that ¢; isa Floquet multiplier and c; isa corresponding eigenvector 
of e8?. Consider x(t) = X(t)c; = P(t)e®‘c;, a solution of our system (6.4.10). It satisfies 


x(t + p) = P(t + p)eB+Pc; = P(t)e®!e®Pc, = p;P(t)e?*c; = p;x(t), 
so that 
x(t + Pp) = p;X(). (5.4.12) 
In particular, the system has a periodic solution (satisfying x(t + p) = x(t)), 
exactly when one of the Floquet multipliers is equal to 1. (If one of the Floquet mullti- 
pliers is equal to —1, then the system has a solution of the period 2p.) 
The general solution of the periodic system is 
x(t) = P(t)eP*c. (5.4.13) 


The matrix P(t) is periodic, and therefore it is bounded. We see that x(t) > 0, ast > oo, 
exactly when the eigenvalues of B are either negative or have negative real parts. The 
eigenvalues A;’s of B are called the characteristic exponents. The Floquet multipliers 
p;’s are the eigenvalues of e8?, so that p; = e+i?, or A; = *in p;. It follows that if the 
(complex) modulus of all Floquet multipliers is < 1, then all characteristic exponents 
A; are either negative or have negative real parts, and then all solutions of the system 
tend to zero, as t > oo. On the other hand, if some Floquet multiplier p; has 
complex modulus greater than one, then iterating gives x(t +np) = pe} x(t), for 
any integer n, concluding that x(t) is an unbounded solution of the system (6.4.10). 
Returning to the formula (6.4.13), denote y(t) = e8'c. Then 


y' = By. (5.4.14) 
It follows that the change of variables x(t) > y(t), given by 
x = P(t)y, 


transforms the periodic system (6.4.10) into the system (6.4.14) with constant coeffi- 
cients. 


In case X(t) is the normalized fundamental matrix, D = X(p) by @.4.1]), so that 
X(t + p) = X(X(p), 


and the matrix X(p) is called the monodromy matrix. 


Mathieu's and Hill's equations. Mathieu’s equation for y = y(t) has the form 
y” + (6 + €cos 2t) y = 0, (5.4.15) 


depending on two constant parameters 6 > Oande. Ife = 0, one obtains a harmonic os- 
cillator which models small vibrations of a pendulum attached to the ceiling (discussed 
in Chapter 2). If the support of the pendulum (or the ceiling itself) moves periodically 
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in the vertical direction, one is led to Mathieu’s equation (§.4.15). We shall discuss a 
more general Hill’s equation 
y” +a(t)y = 0, (5.4.16) 
with a given p-periodic function a(t), so that a(t + p) = a(t) for all t. For Mathieu’s 
equation, p = 7. 
Let y,(t) be the solution of (6.4.16), satisfying the initial conditions y(0) = 1 and 
y’(0) = 0, and let y(t) be the solution of (6.4.16), with y(0) = 0 and y’(0) = 1, the nor- 
malized solutions. Letting x,(t) = y(t) and x2(t) = y’(t), one converts Hill’s equation 


(5.4.16) into a system 


x' = A(t)x, (5.4.17) 
: x(t) 0 1 . 
with x(t) = x(t) and A(t) = a(t) 0 } Since A(t + p) = A(t), the Floquet 


y(t) y2(t) 
yi(t) y2(t) 
solution matrix of (6.4.17), and so the Floquet multipliers are the eigenvalues ep, and p, 
of the monodromy matrix D = X(p). The sum of the eigenvalues pe, + p2 = tr X(p) = 
y,(p) + y5(p) = 8, a quantity which is easily computed numerically. Since tr A(t) = 0, 
it follows by Liouville’s formula (presented in the Problems) that 


theory applies. The matrix X(t) = | gives the normalized fundamental 


Pip2 = |X(p)| = |X(0)| = | = 1. (5.4.18) 
It follows that p, and p, are roots of the quadratic equation 
ep’ —Bp+1=0, 


Bty B?- 
2 


p 


which are p = 


Case 1. Assume that |6| > 2. Then Floquet multipliers o, and p, are real and distinct, 
and by (6.4.18), one of them is greater than 1 in absolute value. By the Floquet theory, 
the system (6.4.17), and hence Hill’s equation, has unbounded solutions. One says that 
Hill’s equation is unstable in this case. 


Case 2. Assume that |6| < 2. The Floquet multipliers e, and e, are complex and 
distinct, and by (5.4.18), both have complex modulus equal to one, |9;| = |e2| = 1. 
Since p, # 01, one can diagonalize X(p): 


Pp, +O -1 
X(p)=S Sos 
) | 0 p2 


where the entries of S and S~! are complex constants. Any number t can be written in 
the form t = ty + np, with some integer n and ty € [0, p). Then iterating the relation 
X(to + p) = X(to)X(p), obtain 


X(t) = X(lo + np) = X(lo)X(p)" = X(lo)S -_ a 
2 


Clearly, |e7| = |e | = 1, for any n. It follows that the fundamental matrix X(t) has 
bounded entries for all t, and then all solutions of the system (6.4.17) (which are given 
by x(t) = X(t)c) are bounded. One says that Hill’s equation is stable in this case. 


Case 3. 6 = 2. Then p, = p2 = 1. The system (6.4.17) has a p-periodic solution. (The 
other solution in the fundamental set is known to be unbounded.) 
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Case 4. 6 = —2. Then p, = p2 = —1. The system (6.4.17) has a solution of period 2p. 
(The other solution in the fundamental set is known to be unbounded.) 


Massera’s Theorem. We now consider nonhomogeneous periodic systems 
x =A(Hx+f(), with At+p)=AO), fit+p =f, (5.4.19) 


where f(t) is a given p-periodic vector function. The following spectacular theorem is 
due to the Uruguayan mathematician J. L. Massera (published in 1950). 


Theorem 5.4.2. Assume that the system (5.4.19) has a bounded solution, fort > 0. Then 
the system (5.4.19) has a p-periodic solution. 


Observe that this theorem provides a strong conclusion, with the minimum of as- 
sumptions. 


Proof. Let z(t) be a bounded solution, whose existence is assumed in the statement 
of the theorem, and let X(t) be the normalized fundamental matrix of x’ = A(t)x, so 


that by 
t 
Z(t) = X(t)z(0) + xo f X7~1(s) f(s) ds. 
0 


In particular, 

z(p) = X(p)z(0) + b, 
where we denoted b = X(p) fe X71(s) f(s) ds. By the periodicity of our system, z(t + p) 
is also a solution of (6.4.19), which is equal to z(p) at t = 0. Therefore, using 


again, 
z(t + p) = X(t)z(p) + X(t) [ mor ds. 
Then ° 
2(2p) = X(p)z(p) + b = X(p) (X(p)z(0) + b) + b = X*(p)z(0) + X(p)b + b. 
By induction, for any integer m > 0, 


m-1 


z(mp) = X™(p)z(0) + >) X*(p)b. (5.4.20) 
k=0 
For any solution of (6.4.19), 
t 
x(t) = X(t)x(0) + X(t) [ X71(s) f(s) ds. 
0 


We obtain a p-periodic solution, with x(p) = x(0), provided that the initial vector x(0) 
satisfies 

(I — X(p)) x(0) = b, (5.4.21) 
where, as before, b = X(p) Je X—1(s) f(s) ds. 

Assume, contrary to what we want to prove, that the system has no 
p-periodic solutions. Then the system has no solutions. This implies that 
det (J — X(p)) = 0, and then det (I ~X(p))' = det(I —X(p)) = 0. It follows that 
the system 

(I—X(p))' v=0 (5.4.22) 
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has nontrivial solutions, and, by the Fredholm alternative, we can find a nontrivial 
solution Ug of (6.4.22), which satisfies 


(b, Uy) # 0. (5.4.23) 


(Otherwise, the system (5.4.21) would have solutions.) From (6.4.22), Ug = X(p)" vp; 
then X(p)" Up = X*(p)? ug, which gives ug = X?(p)" Up, and inductively we get 


Up = X*(p)"v 9, _ for all positive integers k. (5.4.24) 


We now take the scalar product of with Up and use (6.4.24): 


m-1 


(z(mp), vo) = (X™(p)z(0), U9) + >) (X*(p)b, vo) 
k=0 
m-1 


= (2(0),X™(p)"U9) + >) (b,X*(p)" vp) = (z(0), U9) + m(b, Vo) > 00, 
k=0 


asm — oo, in view of (6.4.23). But z(t) is bounded (and so (z(mp), Up) is bounded). We 
have a contradiction, which implies that the system (6.4.19) has a p-periodic solution. 
° 


There is a similar Massera theorem that deals with second-order nonlinear equa- 
tions (here x = x(t)) 


x" + f(t,x) =0, (5.4.25) 


where the function f(x, t) is assumed to be continuous, differentiable in x, and p- 
periodic in t, so that 


f(t + p,x) = f(t, x), for all t and x. (5.4.26) 


Theorem 5.4.3. In addition to (5.4.26), assume that all solutions of (6.4.25) continue 
for all t > 0 and one of the solutions, xo(t), is bounded for all t > 0 (so that |xo(t)| < M 
for some M > Oand allt > 0). Then (6.4.25) has a p-periodic solution. 


For a proof and an interesting historical discussion, see P. Murthy [20]. 


5.5 Solutions of Planar Systems Near the Origin 


We now describe the solution curves in the x,x,-plane, near the origin (0,0), of the 
system 


x’ = Ax, (5.5.1) 

with a constant 2 x 2 matrix A = | fu 12 and x = 4 } 

a2, 922 

If the eigenvalues of A are real and distinct, 2, # A,, with the corresponding eigen- 
vectors €, and &,, we know that the general solution is 


x(t) = cent é, + cn et2té,, 
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We study the behavior of solutions as t > +oo and distinguish between the following 
cases. 


(i) Both eigenvalues are negative, 2, < A, < 0. The values of c, and c, are determined 
by the initial conditions. If c, = 0, then x(t) = c,e"!'é, tends to the origin (0, 0) as 
t > oo, along the vector &, (or —&,). If c. # 0, then 


x(t) & c,e2"E,, for large t > 0. 


The solution curves (x,(t), x2(t)) tend to the origin (0,0) as t > oo, and they are 
tangent to the vector &. The origin is called a stable node. 


Stable node. Unstable node. 


(ii) Both eigenvalues are positive, 2, > 2, > 0. If c, = 0, then x(t) = cye41", tends to 
the origin (0,0) as t > —oo, along the vector & (or —&,), so that solutions emerge 
from the origin along the vectors +é,. If c, # 0, then 


x(t) © c,e?"E,, as t > —0o0. 


The solution curves (x, (t), x2(t)) emerge from the origin (0, 0), and they are tangent 
to the vector 5. The origin is called an unstable node. 


(iii) The eigenvalues have different sign, 2; > 0 > A. Incase the initial point lies along 
the vector & (so that c} = 0), the solution curve (xj(t), x(t)) tends to the origin 
(0,0), as t > oo. All other solutions (when c, # 0) tend to infinity, and they are 
tangent to the vector }, as t — oo. The origin is called a saddle . For example, 


, 1 0 : 
ifA = niet } we have a, = 1, Aa, = —1, and x, = ce’, x» = ce. Write 
xX, = Ge = C t= eR Denoting c = cc, we see that solutions are the 
et X1/c, xy 
hyperbolas x, = which form a saddle near the origin. 
x] 


Turning to the case of complex eigenvalues, we begin with a special matrix B = 


| Pa } with the eigenvalues p + iq, and consider the system 


y’ = By. (5.5.2) 
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61 


9) 


Center. 


Saddle. 


Its solutions are 


y(t) = | ‘ J-e| cosqt sinqt || C |. 
2 


—singt cosqt Cy 


Cy 
C2 
many times, as t > co). We say that the origin is a center. If p < 0, the solutions spiral 
into the origin. The origin is called a stable spiral. If p > 0, we have an unstable spiral. 

Assume now that A is a 2 x 2 matrix with complex eigenvalues p + iq, q # 0. Let 
—€ = u + iu be an eigenvector corresponding to p + iq, where u and v are real vectors. 
We have A(u + iv) = (p + iq)(u + iv) = pu — qu + i(pu + qu), and separating the real 
and imaginary parts, 


If p = 0, then any initial vector is rotated clockwise around the origin (infinitely 


Au=pu-—quv and Av=qu+ pv. (5.5.3) 


We form a 2 X 2 matrix P = [u v], which has the vectors u and v as its columns. Then, 


using (6.5.3) 


AP = [Au Av] = [pu qu qu + po] = [u all 2 = PB, 
where B is the special matrix considered above. We now make a change of variables 


x = Py, transforming (6.5.1) to 
Py' = APy = PBy 


and then to the system @.5.2), which we have analyzed above (P-!, the inverse of P, 
exists, because the vectors u and v are linearly independent, which is justified in the 
exercises). We conclude that the origin is a center if p = 0, a stable spiral if p < 0, and 
an unstable spiral if p > 0. If the determinant |P| > 0, the motion on these curves is 
clockwise, and in case |P| < 0, the motion is counterclockwise. (Recall that the solution 
curves of y’ = By move clockwise.) 
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Stable spiral. Unstable spiral. 


One often denotes the unknown functions by x(t) and y(t). Then the system (6.5.1) 
takes the form 


dx 
a + Qy2y; 
dy 
at = az1xX + azz). 


Dividing the second equation by the first, we can write this system as a single equation 
dy _ 4x + any 
dx  ayx+t+apy’ 


although one can no longer distinguish the direction along the integral curves. 


5.5.1 Linearization and the Hartman-Grobman Theorem. We now briefly 
discuss nonlinear planar systems. Chapter | will be entirely devoted to nonlinear sys- 
tems. 

Suppose that a nonlinear system (for x = x(t) and y = y(t)) 


x' = f(x,y), 
y = g(x,y), 


with differentiable functions f(x, y) and g(x, y), has a rest point (Xo, yo), which is de- 
fined by 


(5.5.4) 


f (Xo, Yo) = 8(X0, Yo) = 0. 
By Taylor’s formula, we approximate for (x, y) near (Xo, Yo) 
F(%¥) & feo» Yo — Xo) + fy%o» YoY — Yo): 
8(%, Y) & &x(Xo. Yo(X — Xo) + Sy(%o, YY — Yo)- 
Letting x—x,) = uand y—yp = v, With x’ = uw’ and y’ = v’, we approximate the system 
by the linear system 
ul = f(Xo, Yo)U+ fy(Xo. Yo)v, 


: (5.5.5) 
VU’ = 8x(Xo, Yo)U + By(Xo, Yo)v. 
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This approximation is valid for (u, v) close to (0,0), which corresponds to (x, y) being 
near (Xo, Yo). One calls (6.5.5) the linearized system. Its matrix 


Ae Fe(%0.¥o) —fy(%os Yo) 
&x(X0.Yo) By(Xo. Yo) 


is called the Jacobian matrix. We analyzed the behavior of linear systems near the rest 
point (0, 0) in the preceding section. The natural question is whether the picture near 
(0, 0) for the linearized system remains similar for the nonlinear system 
near (Xo, Yo). The Hartman-Grobman theorem says that this is the case if the Jacobian 
matrix A does not have purely imaginary or zero eigenvalues. So that if the linearized 
system has a stable or unstable node, or a stable or unstable spiral, or a saddle at (0, 0), 
the picture remains similar for the nonlinear system near (Xp, yj). On the other hand, 
in case of a center, the picture may be different. 

The Hartman-Grobman theorem also holds for n x n matrices, and the rest point 
which does not have purely imaginary or zero eigenvalues is called hyperbolic. For the 
proof and the precise statement, see the book of M. W. Hirsh and S. Smale [13]. 


Example 5.5.1. The system 
’ 2 2 
x’ =-y—x(x*+y*), 
( ) (5.5.6) 
y’ = x — y(x? + y’) 


has a unique rest point at x9 = 0, yp = 0. Indeed, to find the rest points we solve 
-y—x(x’?+y*) =0, 
x—y(x?+y*) =0. 
Multiplying the first equation by x, the second one by y, and adding the results gives 
— (x? + yy =0, 


or x = y= 0. The linearized system at the rest point (0, 0), 


u’ =—v, 
; (5.5.7) 
v= 


u, 
has acenter at (0, 0), and its trajectories are circles around (0, 0). The Hartman-Grobman 
theorem does not apply. It turns out that the trajectories of spiral into (0,0) (so 
that (0,0) is a stable spiral). Indeed, multiplying the first equation of by x, the 


second one by y, adding the results, and calling p = x? + y”, we see that al = —p?. 


This gives p(t) = cn — 0,ast > oo. 


Example 5.5.2. The system 
x =—y+ xy, 
, (5.5.8) 
Yyux-x'y 
has a rest point (0,0). The linearized system at the rest point (0,0) is again given by 
(5.5.7), so that (0,0) is a center. We claim that (0, 0) is a center for the original system 


too. Indeed, multiplying the first equation in by x, the second one by y, 
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and adding the results, we see that < (x? + y”) = 0, or 
V+y=e 
and all trajectories are circles around the origin. 
The system has another rest point: (1,1). The Jacobian matrix at (1, 1) is 

- ] } It has zero as a double eigenvalue, and so it does not belong to any of the 
types of the rest points that we considered. 
Example 5.5.3. The rest points of the system 

x’ =2x-—y+2, 

y= xy 
are (0, 2) and (—1,0). (xy = 0 implies that either x = 0 or y = 0.) The Jacobian matrix 


(5.5.9) 


‘ 2 -l 
at (0, 2) is > 0 
unstable spiral at (0,0). By the Hartman-Grobman theorem, solutions of spiral 


. Its eigenvalues are 1 + i, so that the linearized system has an 


out of (0, 2). The Jacobian matrix at (—1, 0) is ; - } Its eigenvalues are 2 and —1. 


The linearized system has a saddle at (0,0), and by the Hartman-Grobman theorem, 
the system has a saddle at (—1, 0). 


5.5.2 Phase Plane and the Prufer Transformation. We saw that some 2 x 2 
systems can be transformed into a single second-order equation. Often one transforms 
the opposite way. For example, in the equation 


y"(t) — a(t)y(t) = 0 (5.5.10) 


we let y’ = v, thenv’ = y” = a(t)y, and we convert this equation into an equivalent 
system, with the variables (y, v) depending on t: 


Ul 


Yo=. 7U; 

v’ = a(t)y. 
One calls the (y, v)-plane, or the (y, y’)-plane, the phase plane. Solutions of 
define curves (called trajectories) in the (y, y’) phase plane. 


It is often useful to use polar coordinates in the phase plane, a technique known 
as the Priifer transformation. We set 


(5.5.11) 


y=rcosé, 


eae (5.5.12) 


with r = r(t), 8 = O(t). Using that 0(t) = arctan e, compute 


”" 2 ”" 72 72 
4 I VT 


1\2 2 2 72 2 72 
1+() y ery very 


Using (65.12), we have (observe that y? + y’” = r?) 
6'(t) = a(t) cos? O(t) — sin? O(t). (5.5.13) 
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The point here is that this equation for 6(t) is decoupled from the other polar coordinate 
r(t) (it does not contain r(t)). 

To give an application, let us assume that some solution of the equation (6.5.10) 
satisfies y(t) > 0, y'(t) < O fort > ty > 0, and lim;_,,, y(t) = 0. Assume also that 
a(t) > a, > 0 for t > to. We shall show that y(t) decays exponentially as t > oo. 


. 


y 


The regions A and B. 


We are given that the trajectory (y(t), y’(t)) lies in the fourth quadrant of the phase 
plane. Consider the line 6 = 27 — ¢, or 


y’' =tan(2z7 —¢)y=— taney (5.5.14) 
in the fourth quadrant of the phase plane (the dashed line in the picture). We claim 


that for ¢ small, the trajectory (y(t), y’(t)) cannot go above this line (or into the region 
B in the picture). Indeed, assuming the contrary, we can find 


O(t) € (2a —«, 27), (5.5.15) 
with € small, so that cos @(t) = 1 and sin O(t) ~ 0. It follows from (5.5.13) that 


a(t) > sah: (5.5.16) 


The function O(t) is increasing, which implies that (6.5.16) continues to hold, so long 
as (6.5.15) does. Then at some finite time t;, we have 0(t,) = 27, which corresponds 
to y'(t,) = 0, contradicting our assumption that y’(t) < 0 for all t. It follows that the 
trajectory has to stay below the dashed line (or in the region A), so that 
y(t) < —taney. 
Integrating this inequality over (tg, t), we conclude 
y(t) < yltpjem Bnet), 


which implies the exponential decay. 


5.5.3 Problems. 


I. 1. Consider a 2 x 2 system 
x’ = Ax. (5.5.17) 
Assume that , is a repeated eigenvalue of A (A, = 1,), which has two linearly 
independent eigenvectors. Show that the solutions are x(t) = e41'c, which are 
straight lines through the origin in the x,x -plane (c is an arbitrary vector). (If 
A, < 0, solutions along all of these lines tend to the origin, as t > oo, and we 
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say that the origin is a stable degenerate node. If A, > 0, the origin is called an 
unstable degenerate node.) 

2. Assume that A, isa repeated eigenvalue of A (A, = A,), which has only one lin- 
early independent eigenvector &. If A; < 0, show that all solutions of 
approach the origin in the x,x2-plane as t > oo and they are tangent to & 
(again one says that the origin is a stable degenerate node). If A, > 0, show 
that all solutions of approach the origin in the x, x,-plane as t > —oo 
and they are tangent to € (an unstable degenerate node). 


Hint. Recall that using the generalized eigenvector 7, the general solution of 


65.17) is 


x(t) = cyetté +05 (terté 4: ety) ; 


3. Consider the system 
dx 
Ab = ax + by, 
dy 
dt 
where a, b, m, and n are real numbers. 


(5.5.18) 
= mx +ny, 


(i) Put this system into the form 
(mx + ny) dx — (ax + by) dy = 0. (5.5.19) 


Hint. Express 2 


dx . 
(ii) Assume that (0, 0) is a center for (6.5.18). Show that the equation (6.5.19) 
is exact, and solve it. 


Hint. One needs n = —a (and also that b and m have the opposite signs), 
in order for the matrix of to have purely imaginary eigenvalues. 


Answer. mx? + nxy — by? =c,a family of closed curves around (0, 0). 
(iii) Justify that the converse statement is not true. 


Hint. For example, if one takes a = 1, b = 1,m = 3, andn = —1, then 
the equation is exact, but (0, 0) is a saddle. 


II. Identify the rest point at the origin (0, 0). Sketch the integral curves near the origin, 
and indicate the direction in which they are traveled for increasing t. 


,_| 3 2 
ee ar 


Answer. Unstable node. 


Answer. Saddle. 
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Answer. Center. 


4. 
x' = 2x +4y, 
y =—5x -Ty. 
Answer. Stable node. (Observe that the variables here are x and y, rather than 
xX, and x3.) 
5. 
dx 
are x — 2y, 
dy 
a 4x — 3y. 


Answer. Stable spiral. 


d x- 
6. 2 = 


dx 4x+y" 
: ; 4 1 
Hint. Convert to a system form for x(t) and y(t), with A = | } 


Answer. Unstable spiral. 


Answer. Center. 


d x 
8, 2 ==, 
dx y 


Answer. Saddle. Solution: y* — x” =c. 


3 3t 


Answer. Stable degenerate node. Solution: x,(t) = cye~*", x,(t) = c,e~*". 


d 
10. =, 
dx x 


Answer. Degenerate node. 


; 1 1 : 
ll. xX = x; ais a constant. 
a 1 
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Answer. Saddle for a > 1, unstable node for 0 < a < 1, unstable degenerate 
node when a = 0, unstable spiral if a < 0. 


Ill. Find all of the rest points for the following systems, and identify their type, for both 
the corresponding linearized system and the original system. 


1. 
x =2x+y*-1, 
y =6x-y? +1. 


Answer. (0,1) is a saddle; (0, —1) is an unstable spiral for both systems. 


Answer. (2,2) is a saddle; (—2, 2) is a stable spiral for both systems. 


x'=y-x, 
y =(*-2)9 +). 


Answer. (—1,—1) is a stable node; (2, 2) is a saddle for both systems. 


x’ = —3y+x(x*+y?), 
y =3xt+y(x*+y?). 


Answer. (0,0) is a center for the linearized system and an unstable spiral for 
the nonlinear system. 


IV. 1. (i) Justify the formula for differentiation of a determinant 


d| a(t) b(t)|_ | a(t) b(t) a(t) b(t) 
dt| c(t) d(t)| | c(t) d(t) c(t) d'(t) |" 
(ii) Consider a system 
x' = A(t)x, (5.5.20) 


Xy1(t) xXy2(t) 

Xq1(t) X22(t) 

fundamental matrix, so that the vectors x6) and Xi2(t) are 
X1(t) Xp2(t) 

two linearly independent solutions of (6.5.20). The determinant W(t) = 

|X(t)| is called the Wronskian of (§.5.20). Show that for any number fp 


with a 2 x 2 matrix A = [aj,;(t)]. Let X(t) = | be its 


t 
W(t) = Wtoelio *AO4, 


where the trace tr A(t) = aq, (t) + a2(t). 


(5.5.21) 
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Hint. Calculate 


X4,(1)  X42(t) 
X(t) Xp2(t) 


X(t) X42(t) 
X5i(t)  xX}2(t) | 


WF oo 


(5.5.22) 


Using properties of determinants, calculate 


X4,(t)  X}2(t) - 
X(t) Xp2(t) 


Ay X 11 + Ay2X21 Ay X42 + Aj2X22 
X21 X22 


441X414 X12 
X21 X22 


Similarly, the second determinant in (6.5.22) is equal to a.,W. Then 
W'= (ay, + An) W =trAW. 


(iii) Show that the formula (6.5.21), called Liouville’s formula, holds also in 
the case of n x n systems (6.5.20). 


2. Consider the system 
x’ = Ax, (5.5.23) 


where A is ann Xn matrix with constant entries. Show that e“* is the normal- 
ized fundamental solution matrix. 


Hint. Recall that x(t) = e4‘c gives the general solution. Choosing the first 
entry of the vector c to be one and all other entries zero, conclude that the first 


column of e“ is a solution of (6.5.23). 


3. (i) Consider the system 
x' = A(t)x, (5.5.24) 


where A(t) is an m x n matrix with all entries continuous on (tg, 00). 
Derive the following Wazewski inequality (for t > to): 


od ' A(s)d 
lato f}ero2 4 < [x(A)I] < [[x(to)lJe"0®%, 


where A(t) and A(t) are the smallest and the largest eigenvalues of the 
matrix - (A + A’) and ||x(t)|| is the length of the vector x(t). 


Hint. Observe that the matrix - (A + A’) is symmetric, so that all of its 
eigenvalues are real. Then integrate the inequality 


d d 
qr? = a * = x™(A+A™)x < 2A(t)||x(0)|I?. 


yt 3 
(ii) Let A(t) = = 2 } Show that all solutions of (6.5.24) tend to 


zero, as t > oo. 
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5.6 Controllability and Observability 


5.6.1 The Cayley-Hamilton Theorem. Recall that the eigenvalues 1,, A ,...,4n 
of an n X n matrix A are roots of the characteristic equation 


|A —Al| =0. 


The determinant |A — AI| is an nth-degree polynomial in A, called the characteristic 
polynomial: 


p(A) = AA” + a,a"-1 test Ayn4A + an, 
with some coefficients dg, dj, ..., Ay. 
Cayley-Hamilton Theorem. Any square matrix A is a root of its own characteristic 
polynomial, so that 
p(A) = aA" + aA" 1 +++» +a,_;A + a,I =O, 


where O is the zero matrix. 


Proof. We begin by assuming that the matrix A is diagonalizable, so that 
A = Sdiag (Aj, Az,...,An) St. 


Here diag (Aj, Ap, ...,A,) is the diagonal matrix with entries A, A2,...,A, and S is anon- 
singular matrix. Recall that AX = S diag (ak SAN aie at) S71, for any integer k, and then 


p(A) = S diag (p(A,), p(Ag), ..» P(An)) S7! = SOS! = O. 


The proof for the general case can be given by a continuity argument, which we 
sketch next. An arbitrarily small perturbation of any matrix A produces a matrix B 
with distinct eigenvalues and hence diagonalizable (over complex numbers). We have 
p(B) = O, by above, while the matrix p(A) is arbitrarily close to p(B), and therefore 
p(A) =O. © 


We shall use the following corollary of this theorem. 


Proposition 5.6.1. (i) For any integer s > n, the matrix A‘ is a linear combination of 
1,A,A’,...,A?). 


(ii) The matrix e4 is also a linear combination of I, A, A?,..., A"). 


Proof. Performing the long division of polynomials, write 


X= pay) +r), 


where q(A) is a polynomial of degree s — n and r(A) is a polynomial of degree n — 1, 
r(A) = HA") + + + 2A + M_1, With some coefficients 79, ... ,%_2,%_1. Then, using 
the Cayley-Hamilton theorem, 


AS = p(A)q(A) + r(A) = r(A) = nA™ 1 4+--- +4 ,A+H_1, 


concluding the proof of the first part. The second part follows from the definition of 
co =AS 
° 


the exponential e4 = }) = 
> Ss! 


5.6. Controllability and Observability 215 


5.6.2 Controllability of Linear Systems. We consider the linear system 
x’ = Ax + Bu(t). (5.6.1) 


Here x(t) € R” is the unknown vector function, with the components x;(f), x2(t),..., 
X,(t), while the vector function u(t) € R™, m > 1, is at our disposal, the control. The 
n Xn matrix A and the n x m matrix B have constant coefficients and are given. If we 
regard u(t) as known, then solving the nonhomogeneous system with the initial 
condition x(0) = X9 gives 


t 
x(t) = e4*x,) + [ eA) Bu(s) ds. 
0 


One says that the integral curve x(t) is generated by the control vector u(t), with x(0) = Xo. 


Definition. We say that the system (6.6.1) is controllable if, given any duration p and 
two arbitrary points x9, Xp E R", there exists a continuous vector function a(t) from 
[0, p] to R™, such that the integral curve x(t) generated by u(t) with x(0) = Xp satisfies 
X(p) = Xp: 


In other words, controllability means that 
Pp 
Xp = e4P x, + [ e4-) Bai(s) ds, 
0 
for some u(t), or 
Pp 
[ eA®-OBa(t) dt = xp — eA? xp. (5.6.2) 
0 

We form Kalman’s controllability matrix 


K =(BABA?B ... A"“'B). 


(The first m columns of K are those of B, the next m columns are given by AB, and so 
on.) The type (or size) of K isn x nm. Observe that rank K < n. 


Theorem 5.6.1 (R. Kalman). The system (6.6.1) is controllable if and only if 


rank K = n. 


Proof. Define the matrices 


p 
C(t) =e40-9B and G= [ C(t)C7(t) dt, 
0 
where C7 is the transpose of C. The matrix function C(t) is of type n x m, while the 
constant matrix G is of type n xn. 
We claim that controllability of (6.6.1) is equivalent to G being invertible. Assume 
that G is invertible. We shall show that the vector 


ii(t) = BT eA" @-NG-1 (xp — e4? xo) 
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gives the desired control. Indeed, 
P Pp 
[ eAP-) Ba(t) dt = ( [ eA) BBT eA" (P-1) a) G7! (Xp — e4P x9) 
0 0 


= GG"! (xp — e4P x9) 
= Xp — e4P xo, 
and the system (§5.6.1)) is controllable by (6.6.2). 
Conversely, assume now that the system (6.6.1) is controllable. We wish to show 


that G is invertible. Assume, to the contrary, that G is not invertible. Then its rows are 
linearly dependent. Therefore there exists a nonzero column vector v € R”, such that 


v'G =0. (5.6.3) 


(If U,, U2, ...,V, are the entries of v, while g), g,..., 2, are the rows of G, then is 
equivalent to Uv, g) + U8) +--+: + U,g, = 0.) Then 


p p 
0=v'Guv= [ v? C(t)CT (t)u dt = \|v? C(t) ||? dt. 
0 0 


It follows that 
v' C(t) = 0, for all t € [0, p]. (5.6.4) 


Because the system (6.6.1) is controllable, for any xp and x, we can find a(¢) so that 
holds, or 


p 
i C(t)u(t)dt = x, — e4P xo. 


0 
Choose now x9 = 0 and any x, such that v? x, # 0. Using (6.6.4), we have 


p 
0= [ v? C(t)a(t) dt = v? xp #0, 
0 


a contradiction, proving that G is invertible. 

We complete the proof by showing that G being invertible is equivalent to rank K = 
n. Assume that G is not invertible. Then holds for some vector v # 0, as we saw 
above. Write 


Co 

yohea vee (B= > 

i=0 

It follows that v7A'B = 0 for all i > 0, which implies that v’K = 0. (Recall that v'K 

is a linear combination of the rows of K.) This means that the rows of K are linearly 

dependent, so that rank K < n. By the logical contraposition, if rank K = n, then G is 
invertible. 

Conversely, assume that rank K < n. Then we can find a nonzero vector v € R”, 
such that 


vTA' 


i 
7 2G —t'=0, forallt €[0, p]. (5.6.5) 


v' K =0. 
By the definition of K this implies that v’ A'B = 0 for i = 0,1,...,n — 1. By Proposition 
5.6.1] we conclude that v7 A'B = 0 for all i > 0. Then by 6.6.5), v7 C(t) = 0. It follows 
that 


p 
v'G =| v? C(t)CT(t) dt = 0, 
0 
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so that the rows of G are linearly dependent, and then G is not invertible. Hence, if G 
is invertible, then rank K = n. © 
Example 5.6.1. The system (we use (x, y) instead of (x, x2)) 

x’ = u(t), 

y=x 


; 1 0 O 1 0 
is controllable. Here B =| 0 ja-| 1 0 jx=| 64 JpramicK = 2 


Writing this system as a single equation y” = u(t), we see that the height y(t) of 
an object and its velocity y'(t) = x(t) can be jointly controlled with a jet pack (which 
controls the acceleration function u(t)). 


Example 5.6.2. The system 


x’ = u(t), 

y’ =—u(t) 
; i een ee _f 1 0 _ 
is not controllable. Here B = 4 a= | 0-6 )x= | aw fiana rank K = 1. 


Writing this system as (x + y)’ = 0, we conclude that x(t) + y(t) = constant, 
independently of the control u(t). It follows that, for example, the point (1, 1) cannot 
possibly be steered to (2, —3), sincel1+142-3. 


5.6.3 Observability. We now consider a control-observation process 
x’ = Ax + Bu, 


> =Cx. (5.6.6) 


Here the first equation corresponds to using the control vector u(t) to steer the solution 
x(t), as in the preceding subsection, so that x € R", u € R™, and we assume that the 
given matrices A of type n x n and B of type n x m have constant entries. The second 
equation involves a q xn observation matrix C with constant entries and an observation 
vector v(t) € R4. if C is the n x n identity matrix, then v(t) is just x(t).) 


Definition. We say that the system is observable if for every time interval (to, t) 
the knowledge of the input-output pair (u(t), v(t) over (to, t;) uniquely determines the 
initial state x(tg). 


Define the following n x n matrix function 
t 
P(t) = l eA" (s—t0) CT CeA(S-to) ds, 
to 
Lemma 5.6.1. The system is observable if and only if P(t) is invertible for all 
£> to: 


Proof. Assume that the system is observable, but P(t,) is singular, at some t, > 
tg, contrary to the statement of the lemma. Then we can find a nonzero vector Xp € R” 
satisfying P(t,)xX9 = 0. It follows that 


ty 
0= xd P(t))xo = i ||Ce4¢—1o) xo ||? ds, 


to 
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and then 
CeAC-to)x, =0, forall t € (to, t,). (5.6.7) 
Set u(t) = 0. Then x(t) = e4(-‘0) X(t9) is the corresponding solution of (6.6.6), for any 
initial vector X(tp). We have, in view of (6.6.7), 
O(t) = CeAU—t) Z(t) = CeAl-!0) (X(tp) + x0), 


for any constant a. Hence, the input-output pair (0, 0(¢)) does not determine uniquely 
the initial state at tg, contrary to the assumption of observability. It follows that P(t) is 
invertible for all t > to. 

Conversely, assume that P(t,) is invertible, at some t; > tg. Write 


t 
v(t) = CeA@-!0) x(ty) + cf eAC-S) Bu(s) ds. 
to 
Multiplying both sides by eAN(t-to)CT and integrating over (fg, t,) gives 


ty 
P(t,)x(to) = [ AM CT Y(t) dt 
i) 


ty t 
-{ eAT(t-to) CT Gi Aas) dt. 
to 


to 
Since P(t,) is invertible, x(tg) is uniquely determined by the values of u(t) and v(t) over 
the interval (tg, t;), and so is observable. o 


We now consider Kalman’s observability matrix, of type qn x n, 
Cc 
CA 
N=]. 
can-1 


(Its first q rows are those of C, CA gives the next q rows, and so on.) Clearly, rank N < n. 
Theorem 5.6.2 (R. Kalman). The system is observable if and only if rank N = n. 


Proof. If the rank of N is less than n, its columns are linearly dependent, so that for 
some nonzero vector a € R” we have Na = 0, or equivalently 


Ca = CAa = --- = CA""!a =0. 


Proposition implies that 
CeAS-q=0, foralls> to. 


Multiplying by eA'(s-to)CT and integrating over (tg, t), we conclude that P(t)a = 0 for 
all t > tg, which implies that P(t) is not invertible and the system is not observ- 
able by Lemma 5.6.1}, By logical contraposition, if the system is observable, then 
rank N = n. 

Conversely, assume that rank N = n. Let x(t)) and X(tg) be two initial states corre- 
sponding to the same input-output pair (u(t), v(t)). We wish to show that x(tg) = X(to), 
so that the system is observable. The difference z(t) = x(t) — X(t) satisfies 
z' = Az, and also Cz = Cx(t) — CX(t) = v(t) — v(t) = 0, so that 


CeAt-t0) [x(to) — X(to)] = 0, forall t > to. 
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(Notice that z(t) = e4¢~‘e) z(ty).) By taking the first n—1 derivatives and setting t = to, 
we conclude 

CAF [x(to) — &(to)] = 0, k=0,1,..,n—-1, 
which is equivalent to N [x(to) — £(to)] = 0. Since N has full rank, its columns are 
linearly independent, and therefore x(t)) — X(tg) = 0. © 


Notice that observability does not depend on the matrix B. 
5.6.4 Problems. 
1. Calculate the controllability matrix K, and determine if the system is controllable. 
(i) 
Xx, =X, + 2x2. + u(t), 
Xx, = 2x, +X. + u(t). 


Answer. K = ; ; | rank K = 1, not controllable. 


(ii) 
x’ = x, + 2x, — 2u(t), 
x5 = 2X, + Xp. 
—2 -—2 
Answer. K = 0 —4 , rank K = 2, controllable. 
2. LetA = : } Calculate e4. 


Hint. By Proposition 

e4 = aA+ I, 
for some constants a and £. The eigenvalues of A are —1 and 5, which implies that 
the eigenvalues of e4 are e~! and e°, while the eigenvalues of wA + BI are —a + B 
and 5a + f. It follows that 


el=-a+ 8, 
e&=5a4+ £. 


Solve this system for a and f. 


oe: 2e° + 4e-! 2e5 — 2e71 
"61 4e°—4e-! 4e> + 2e-! 


Nonlinear Systems 


We begin this chapter with applications to ecology of two species, including both com- 
peting species and predator-prey interactions, and to epidemiological modeling. Then 
we study some important general aspects of nonlinear systems, including Lyapunov’s 
stability and limit cycles. Finally, we include an in-depth presentation of periodic eco- 
logical models. 


6.1 The Predator-Prey Interaction 


In 1925, Vito Volterra’s future son-in-law, biologist Umberto D’Ancona, told him of the 
following puzzle. During World War I, when ocean fishing almost ceased, the ratio of 
predators (like sharks) to prey (like tuna) had increased. Why did sharks benefit more 
from the decreased fishing? (While the object of fishing is tuna, sharks are also caught 
in the nets.) 


The Lotka-Volterra Equations. Let x(t) and y(t) give, respectively, the numbers of 
prey (tuna) and predators (sharks), as functions of time t. Let us assume that in the 
absence of sharks, tuna would obey the Malthusian model 


x'(t) = ax(t), 


with some growth rate a > 0. (It would grow exponentially, x(t) = x(0)e%.) In the 
absence of tuna, we assume that the number of sharks would decrease exponentially 
and satisfy 

y'(t) = —cy(t), 
with some c > 0, because its other prey is less nourishing. Clearly, the presence of 
sharks will decrease the rate of growth of tuna, while tuna is good for sharks. The 


model is 
x'(t) = ax(t) — bx(t)y(t), 


y(t) = —cy(t) + dx(t)y(@), 
with two more given positive constants b and d. The x(t)y(t) term is proportional to 
the number of encounters between sharks and tuna. These encounters decrease the 


(6.1.1) 
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growth rate of tuna and increase the growth rate of sharks. Notice that both equations 
are nonlinear and we are interested in solutions with x(t) > 0 and y(t) > 0. The system 
represents the famous Lotka-Volterra model. Alfred J. Lotka was an American 
mathematician who developed similar ideas at about the same time as V. Volterra. 

A fascinating story of Vito Volterra’s life and work and of life in Italy in the first 
half of the 20th century is told in a very nice book of Judith R. Goodstein [14]. 


Analysis of the Model. Remember the energy being constant for a vibrating spring? 
We have something similar here. It turns out that any solution (x(t), y(t)) of 
satisfies 

aln y(t) — by(t) + cln x(t) — dx(t) = C = constant, (6.1.2) 
for all time t. To justify that, let us introduce the function F(x, y) = alny—by+clnx— 
dx. We wish to show that F(x(t), y(t)) = constant. Using the chain rule and expressing 
the derivatives from the equations (6.1.1), we have 


x) 4, ¥O «4 

x0) x'(th+a vO) by'(t) 

= c(a — by(t)) — d(ax(t) — bx(t)y(t)) + a(—c + dx(t)) — b(—cy(t) + dx(t)y(t)) 
= 0, 


d oo, (t 
£ Fx(0), WO) = Rex! + By’ =e ae, 


proving that F(x(t), y(t)) does not change with time t. 
We assume that the initial numbers of both sharks and tuna are given: 


x(0)=X9>0, yO)=y>O0. (6.1.3) 


The Lotka-Volterra system, together with the initial conditions (6.1.3), determines both 
populations (x(t), y(t)) at all time t, by the existence and uniqueness theorem, Theorem 
6.1.1] below. Letting t = 0 in (6.1.2), we calculate the value of C: 


Co = aln yy — byp + cln Xg — dxo. (6.1.4) 


In the xy-plane, the solution (x(t), y(t)) defines a parametric curve, with time t being 
the parameter. The same curve is described by the implicit relation 


alny—by+clnx—dx =Cy. (6.1.5) 


This curve is just a level curve of the function F(x, y) = alny — by +clnx — dx, 
introduced earlier (F(x, y) = Co). How does the graph of z = F(x, y) look? Like a 
mountain with a single peak, because F(x, y) is a sum of a function of y, alny — by, 
and of a function of x, cln x — dx, and both of these functions are concave (down). It 
is clear that all level lines of F(x, y) are closed curves. Following these closed curves 
in Figure one can see how dramatically the relative fortunes of sharks and tuna 
change, just as a result of their interaction and not because of any external influences. 


Properties of the Solutions. In Figure 6.1] we present a picture of three integral 
curves, computed by Mathematica in the case when a = 0.7, b = 0.5, c = 0.3, and 
d = 0.2. All solutions are closed curves, and there is a dot in the middle (corresponding 
to a rest point at (1.5, 1.4)). 

When Xp, = c/d and yo = a/b, or when the starting point is (c/d, a/b), we calculate 
from the Lotka-Volterra equations that x'(0) = 0 and y’(0) = 0. The solution is then 
x(t) = c/d and y(t) = a/b for all t, as follows by the existence and uniqueness theorem, 
Theorem which is reviewed at the end of this section. The point (c/d, a/b) is 
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Z = F(x,y) 


—— 


The level lines of z = F(x, y). 


called a rest point. In the above example, the coordinates of the rest point were xp = 
c/d = 1.5 and yo = a/b = 1.4.) All other solutions (x(t), y(t)) are periodic, because 
they represent closed curves. For each trajectory, there is anumber T, a period, so that 
x(t + T) = x(t) and y(t + T) = y(t). This period changes from curve to curve, and it is 
larger the further the solution curve is from the rest point. (This monotonicity property 
of the period was proved only around 1985 by Franz Rothe [26] and Jérg Waldvogel 
[B4]].) The motion along the integral curves is counterclockwise (at the points due east 
of the rest point, one has x’ = 0 and y’ > 0). 


Predator 


Prey 


1 2 3 


Figure 6.1. The integral curves of the Lotka- 
Volterra system. 
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Divide the first of the Lotka-Volterra equations by the solution x(t), and then inte- 
grate over its period T: 


x(t) _ 


x(t) 
"0 a= T—b : d 
ii xO t=aT— [ t. 


But i a dt = In x(f)|p = 0, because x(T) = x(0), by periodicity. It follows that 


a — by(t), 


T 


1 
zi y(t) dt = a/b. 


0 


Similarly, we derive 
T 


1 
a x(t) dt = c/d. 


We have a remarkable fact: the averages of both x(t) and y(t) are the same for all solu- 
tions. Moreover, these averages are equal to the coordinates of the rest point. 


The Effect of Fishing. Extensive fishing decreases the growth rate of both tuna and 
sharks. The new model is 


x'(t) = (a— @)x(t) — bx(t)y(¢), 
y(t) = (Ce + By) + dx) y(0), 


where @ and f are two more given positive constants, related to the intensity of fishing. 
(There are other ways to model fishing.) As before, we compute the average numbers 
of both tuna and sharks: 


T T 


ES i aha a+ Bd. = [ par tacayb: 
T Jo T Jo 

We see an increase for the average number of tuna and a decrease for the sharks as 
a result of a moderate amount of fishing (assuming that a < a). Conversely, de- 
creased fishing increases the average number of sharks, giving us an explanation of 
U. D’Ancona’s data. This result is known as Volterra’s principle. It applies also to in- 
secticide treatments. If such a treatment destroys both the pests and their predators, it 
may be counterproductive and produce an increase in the number of pests! 

Biologists have questioned the validity of both the Lotka-Volterra model and the 
way we have accounted for fishing (perhaps, they cannot accept the idea of two simple 
differential equations ruling the oceans). In fact, it is more common to model fishing, 
using the system 


x'(t) = ax(t) — bx(t)y(t) — hy), 
YO) = —cy(t) + dx) y(t) — ho(t), 


with some given positive functions h,(t) and h(t). 
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The Existence and Uniqueness Theorem for Systems. Similarly to the case of one 
equation, we can expect (under some mild conditions) that an initial value problem for 
a system of differential equations has a solution, and exactly one solution. 


Theorem 6.1.1. Consider an initial value problem for the system 

x'(t) = Ff x(t), 1), x(to) = Xo, 

Y'(t) = alt, x(t), VE), W(to) = Yo. 
with given numbers Xq and yo. Assume that the functions f(t, x,y), g(t, x, y) and their 
partial derivatives f,, fy, 8x, and gy are continuous in some three-dimensional region con- 


taining the point (to, Xo, Yo). Then this system has a unique solution (x(t), y(t)), defined 
on some interval |t — to| < h. 


The statement is similar in case of n equations: 
0 . 
X; = fit, X1,X2,0.5Xy), Xi(to) = X;, i=1,2,...,n, 


where the x? are given numbers. If the functions f; and all of their partial derivatives 
Ofi ; : : : F oe a 3 : 
5, are continuous in some (n + 1)-dimensional region containing the initial point 
5) 
J 
(to, x, ro ses xn then this system has a unique solution (x,(t), x(t), ..., X,(t)), defined 
on some interval |t — tg| < h. 


One can find the proof in the book of D. W. Jordan and P. Smith [15]. 


6.2 Competing Species 


>t 


Solution curves for the logistic model. 


When studying the logistic population model (here x = x(t) > 0 gives the number 

of rabbits) 
x' = x(a— x), (6.2.1) 
we were able to analyze the behavior of solutions, even without solving this equation. 
Indeed, the quadratic polynomial x(a — x) is positive for 0 < x < a, and then x’(t) > 0, 
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so that x(t) is an increasing function. The same quadratic is negative for x > a, and 
so x(t) is decreasing in this range. If x(0) = a, then x(t) = a, for all t, by the unique- 
ness part of the existence and uniqueness theorem, Theorem [1.8.1 so that the solution 
curves look as in the figure. Here a is the carrying capacity, which is the maximum sus- 
tainable number of rabbits. (In Chapter [the logistic model had the form x’ = ax—bx?. 
Letting here x = 2 gives z' = az — z”, which is the equation (6.2.1).) 

If x(0) is small, the solution grows exponentially at first, and then the rate of growth 
gets smaller and smaller, which is a typical logistic curve. The point x = a isa rest point, 
and we can describe the situation by the following one-dimensional picture (the arrows 
indicate that solutions tend to a): 


The logistic equation has a stable rest point at x = a 
and an unstable one at x = 0. 


The rest point x = a is called a stable rest point, because solutions of the equation 
(6.2.1), with x(0) close to a, tend toa ast — oo (lim;_,,, x(t) = a). The point x = Ois 
an unstable rest point, because solutions of (6.2.1), starting near x = 0, tend away from 
it. 

In general, the point x9 is called a rest point of the equation (x = x(t)) 

x' = g(x), (6.2.2) 


with a differentiable function g(x), if g(x) = 0. It is stable (or attractive) if g’(x9) < 0. 
The solutions of (6.2.2), with x(0) near x9, tend to xX) as t > oo. The rest point x9 is 
unstable (or repellent) if g’(x9) > 0. The solutions of move away from it. In 
case g’(X9) = 0, further analysis is needed. 

Suppose now that we also have a population y(t) of deer, modeled by a logistic 
equation 

y' = y(d— y), 

with the carrying capacity d > 0. Suppose that rabbits and deer live on the same trop- 
ical island and they compete (for food, water, and hiding places). The Lotka-Volterra 
model of their interaction is 


ti 


x(a—x-—by), 


(6.2.3) 


ul 


y'=y(d—cx—y). 

The first equation tells us that the presence of deer effectively decreases the carrying 
capacity of rabbits (making it a — by), and the positive constant b quantifies this in- 
fluence. Similarly, the positive constant c measures how detrimental the presence of 
rabbits is for deer. What predictions will follow from the model (6.2.3)? And how do 
we analyze this model, since solving the nonlinear system is not possible? We 
shall consider the system together with the initial conditions 


x(0)=a, y(0)=8. (6.2.4) 


The given initial numbers of the animals, a > 0 and 6 > 0, determine the initial point 


(a, 8) in the xy-plane. We claim that any solution of (6.2.3), satisfies x(t) > 0 
and y(t) > 0 for all t > 0. Indeed, write the first equation in (6.2.3) as 


x’ = A(t)x, where A(t) = a — x(t) — by(t). 
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Then x(t) = ael A(s)ds 5 9, One shows similarly that y(t) > 0. We shall consider the 
system only in the first quadrant of the xy-plane, where x > O and y > 0. 

Similarly to the case of a single logistic equation, we look at the points where the 
right-hand sides of are zero: 

a—x-—by=0, 

ae) (6.2.5) 
These equations give us two straight lines, called the null-clines of the system (6.2.3). 
Both of these lines have negative slopes in the (x, y)-plane. In the first quadrant these 
lines may intersect either once or not at all, depending on the values of a, b, c, and d, 
and that will determine the long-term predictions. The point of intersection of null- 
clines is a rest point. It follows that there is at most one rest point in the first quadrant. 

We shall denote by I the null-cline a — x — by = 0. Above this straight line, we 
have a — x — by < 0, which implies that x’(t) < 0, and the motion is to the left in 
the first quadrant. Below the null-cline I, the motion is to the right. We denote by II 
the null-cline d — cx — y = 0. Above II, y'(t) < 0, and the motion is down, while 
below II the point (x(t), y(t)) moves up. (For example, if a point lies above both I and 
II, the motion is to the left and down, in the “southwest” direction. If a point is above 
I but below II, the motion is northwest, etc.) The system has the trivial solution 
(0,0) (x = 0, and y = 0), and two semitrivial solutions (a,0) and (0,d). The solution 
(a, 0) corresponds to deer becoming extinct, while (0,d) means there are no rabbits. 
Observe that the semitrivial solution (a, 0) is the x-intercept of the null-cline I, while 
the second semitrivial solution (0, d) is the y-intercept of the null-cline I. The behavior 
of solutions, in the long term, will depend on whether the null-clines intersect in the 
first quadrant or not. We consider the following cases. 


y 


d/c a 


Nonintersecting null-clines, with the semitrivial so- 
lutions circled. 


Case 1 (The null-clines do not intersect (in the first quadrant)). Assume first that the 
null-cline I lies above II, so that a/b > d anda > d/c. The null-clines divide the 
first quadrant into three regions. In the region 1 (above both clines), the motion is 
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southwest, in the region 2 it is southeast, and in the region 3 it is northeast. On the 
cline I, the motion is due south, and on the cline II it is due east. Regardless of the 
initial point (a, §), all trajectories tend to the semitrivial solution (a,0), ast > oo. 
(The trajectories starting in the region 3 will enter the region 2 and then tend to (a, 0). 
The trajectories starting in the region 2 will stay in that region and tend to (a, 0). The 
trajectories starting in the region 1 will tend to (a, 0) by either staying in this region or 
going through the region 2.) 


This case corresponds to the extinction of deer and of rabbits reaching their maxi- 
mum sustainable number a. 

In case the null-cline I lies above I, when a/b < danda < d/c, a similar analysis 
shows that all solutions tend to the semitrivial solution (0,d), as t ~ oo, so that the 
species, which has its null-cline on top, wins the competition and drives the other one 
to extinction. 


Case 2 (The null-clines intersect (in the first quadrant)). Their point of intersection 


(=, —) is a solution of the system (6.2.5), a rest point. Its stability depends on 


which of the following subcases hold. Observe that the null-clines intersect the x- and 
y-axes at four points, two of which correspond to the semitrivial solutions. 


Intersecting null-clines, with the semitrivial solu- 
tions on the inside (circled). 


Subcase (a): The semitrivial solutions lie on the inside (relative to the other two points 
of intersection), so that a < d/c and d < a/b. The null-clines divide the first quadrant 
into four regions. In all four regions, the motion is eventually toward the rest point. So- 
lutions starting in the region 2 will always stay in this region. Indeed, on the boundary 
between the regions 1 and 2, the motion is due south, and on the border between the 
regions 2 and 3, the trajectories travel due east, so that solutions starting in the region 
a-—bd d-ac ays : 

se: =e Similarly, solutions 
starting in the region 4 never leave this region and they tend to the same rest point, as 
t > oo. Ifasolution starts in the region 1, it may stay in this region and tend to the rest 


2 stay in this region, and they tend to the rest point ( 
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point or it may enter either one of the regions 2 or 4 and then tend to the rest point. 
Similarly, solutions which begin in the region 3 will tend to the rest point = <<), 
either by staying in this region or going through the regions 2 or 4 (depending on the 
initial conditions). 

This is the case of coexistence of the species. For any initial point (a, 8), with a > 0 


— and lim;,_,,, y(t) = — 

Subcase (b): The semitrivial solutions are on the outside, so that a > d/candd > a/b. In 
the regions 2 and 4, the motion is now away from the rest point. On the lower boundary 
of the region 2, the motion is due north, and on the upper border, the motion is due 
west, so that the trajectories starting in the region 2 stay in this region and tend to 
the semitrivial solution (0,d). Similarly, solutions starting in the region 4 will stay in 
this region and tend to the semitrivial solution (a, 0). A typical solution starting in the 
region 1 will either enter the region 2 and tend to (0, d) or it will enter the region 4 
and tend to (a,0) (this will depend on the initial conditions). The same conclusion 
holds for the region 3. The result is that one of the species dies out, what is known 
as competitive exclusion of the species. (Linearizing the Lotka-Volterra system at 
the rest point, one calculates that the rest point is a saddle, in view of the Hartman- 
Grobman theorem. Hence, there is a solution curve entering the rest point, while a 
typical trajectory tends to one of the semitrivial solutions.) 

What is the reason behind the drastic difference in the long-time dynamics for 
the above subcases? The second equation in tells us that the effective carrying 
capacity of the second species is d — cx(t) < d, so that y(t) < d in the long run. For 
the first species, the effective carrying capacity is a — by(t), and in Subcase (a) (when 
bd < a), we have 


and 6 > 0, we have lim;_,,, x(t) = 


a— by(t)> a—bd> 0, 


so that the first species can survive even when the number of the second species is at its 
maximum sustainable level. Similarly, one checks that the second species can survive, 


a 


Intersecting null-clines, with the semitrivial solu- 
tions on the outside (circled). 
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assuming that the number of the first species is at its maximum sustainable level. In 
this subcase, the competing species do not affect each other too strongly, and so they 
can coexist. 


6.3 An Application to Epidemiology 


Suppose that a group of people comes down with an infectious disease. Will the num- 
ber of sick people grow and cause an epidemic? What measures should public health 
officials take? We shall analyze a way to model the spread of an infectious disease. 

Let I(t) be the number of infected people at time t that live in the community 
(sick people that are hospitalized or otherwise removed from the community do not 
count in I(t)). Let S(t) be the number of susceptible people, the ones at risk of catching 
the disease. The following model was proposed in 1927 by W. O. Kermack and A. G. 
McKendrick: 


c = -rSI, 
dl (6.3.1) 
ai = rSI — yl, 


with some positive constants r and y. The first equation reflects the fact that the num- 
ber of susceptible people decreases, as some people catch the infection (and so they join 
the group of infected people). The rate of decrease of S(t) is proportional to the number 
of “encounters” between the infected and susceptible people, which in turn is propor- 
tional to the product SJ. The number r > 0 gives the infection rate. The first term in the 
second equation tells us that the number of infected people would increase at exactly 
the same rate, if it was not for the second term. The second term, —yI, is due to some 
infected people being removed from the population (people who died from the disease, 
people who have recovered and developed immunity, and sick people who are isolated 
from the community), which decreases the infection rate dI/dt. The coefficient y is 
called the removal rate. To the equations we add the initial conditions 


S(0)=Sp, —-1(0) = Ip, (6.3.2) 


with given numbers So, the initial number of susceptible people, and Ip, the initial 
number of infected people. Solving the equations and will give us a pair 
of functions (S(t), I(t)), which determines a parametric curve in the (S, J)-plane. Alter- 
natively, this curve can be described if we express I as a function of S. 


Write 
dI_ di/dt _ rSI—yI _ yl 1 


dS dS/dt = —rSI rs 

denoting y/r = p. Taking the antiderivative and using the initial conditions (6.3.2), we 
obtain 

IT=-S+plInS +1 + So — pln Sp. (6.3.3) 
Depending on the initial point (So, Io), we get a different integral curve from (6.3.3). 
On all of these curves, the maximum value of I is achieved at S = ¢ ((@) = 0). 
The motion on the integral curves is from right to left, because we see from the first 
equation in that S(t) is a decreasing function of time ¢. If the initial point (So, Ip) 
satisfies Sy > p, then the function I(t) grows at first and then declines; see the picture. 
In this case we say that an epidemic occurs. If, on the other hand, the initial number 
of susceptible people is below p, then the number of infected people I(t) declines and 
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I 


A 


(So, Io) 


(So, Io) 


The solution curves of the system (6.3.1). 


tends to zero, and we say that the initial outbreak has been successfully contained. The 
number 9 is called the threshold value. 

To avoid an epidemic, public health officials should try to increase the threshold 
value p (to make it more likely that Sy < ¢), by increasing the removal rate y (recall that 
p = y/r), which is achieved by isolating sick people. Notice also the following harsh 
conclusion: if a disease kills people quickly, then the removal rate y is high, and such 
a disease may be easier to contain. 

In some cases it is easy to estimate the number of people that will get sick during 
an epidemic. Assume that Ig is so small that we can take I, = 0, while Sg is a little 
larger than the threshold value p, so that Sy = e + v, where v > Ois a small value. As 
time t increases, I(t) tends to zero, while S(t) approaches some final number; call it S- 
(look at the integral curves again). We conclude from that 


S-—plnS+¢ = So —pinSpo. (6.3.4) 


The function I(S) = S — pInS takes its global maximum at S = p. Such a function is 
almost symmetric with respect to p, for S close to p, as can be seen from the three-term 
Taylor series expansion of I(S) at S = p. It follows from that the points Sp and S¢ 
are approximately equidistant from p, so that S ~ p — v. The total number of people 
who will get sick during an epidemic is then Sy — S- © 2v. (This fact is known as the 
Threshold theorem of epidemiology; see for example M. Braun [5]].) 


6.4 Lyapunov’s Stability 
We consider a nonlinear system of equations for the unknown functions x(t) and y(t): 
x’ = f(x,y), x(0) = a, 
y=8y),  yO)=8, 


with some given differentiable functions f(x, y) and g(x, y) and the initial values « and 
f. By the existence and uniqueness theorem, Theorem the problem (6.4.1) has a 
unique solution. 


(6.4.1) 
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Recall that a point (Xp, yo) is called a rest point if 


Fo Yo) = &(X0» Yo) = 0. 

Clearly, the pair of constant functions x(t) = x9 and y(t) = yo isa solution of (6.4.1). If 
we solve the system with the initial data x(0) = xg and y(0) = yo, then x(t) = xo 
and y(t) = yo for all t (by uniqueness of the solution), so that our system is at rest for 
all time. Now suppose that the initial conditions are perturbed from (xp, yj). Will our 
system come back to rest at (x9, yo)? 

A differentiable function L(x, y) is called Lyapunov’s function at (x9, yo) if the fol- 
lowing two conditions hold: 


L(X9, Yo) = 0, 
L(x,y) > 0, for (x, y) in some neighborhood of (x9, yo). 
How do the level lines 
L(x, y) =c (6.4.2) 

look near the point (Xo, yo)? Ifc = 0, then is satisfied only at (xo, yo). Ifc > 0 
and small, the level lines are closed curves around (X9, yo), and the smaller c is, the 
closer the level line is to (Xp, yo). 

Along a solution (x(t), y(t)) of our system (6.4.1), Lyapunov’s function is a function 
of t: L(x(t), y(t)). Now assume that for all solutions (x(t), y(t)) starting near (Xp, yo), 
we have 


£100), y(t)) < 0, for all t > 0, (6.4.3) 


so that the function L(x, y) is decreasing along the solutions. Then one expects that 
(x(t), y(t)) > (Xo, Yo), aS t > oo, and we say that the rest point (x9, yo) is asymptotically 
stable. (As t increases, the solution point (x(t), y(t)) moves to the level lines that are 
closer and closer to (x9, Yo).) Using the chain rule and the equations (6.4.1), we rewrite 


as 
qe eo: y(t)) = L,x' + Lyy’ = Ly f(x, y) + Lyg(x,y) < 0. (6.4.4) 


The following Lyapunov theorem is now intuitively clear (a proof can be found in the 
book of M. W. Hirsh and S. Smale [[13]]). 


Theorem 6.4.1. The rest point (X9, yo) is asymptotically stable, provided that there is a 
Lyapunov function satisfying 
Ly (x y) fy) + Ly, y)g(x,y) <0, — forall (x, y) near (Xo, yo). 

One typically assumes that (x9, yo) = (0, 0), which can always be accomplished by 
declaring the point (xg, yo) to be the origin. Then L(x, y) = ax? + cy’, with suitable 
positive constants a and c, is often a good choice of a Lyapunov function. 

Example 6.4.1. The system 
x! = —2x + xy’, 
y' =-y-3x’y 
has a unique rest point (0,0). With L(x, y) = ax? + cy’, calculate 


£1(0,¥(0) = 2axx' + 2cyy’ = 2ax(—2x + xy”) + 2cy(—y — 3x7y). 
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(x(t), y(t)) 


An integral curve cutting inside the level lines of 
L(x, y). 


If we choose a = 3 and c = 1, this simplifies to 
£160), 0) = —12x? — 2y* <0, for all (x, y) 4 (0,0). 


The rest point (0, 0) is asymptotically stable. 

Observe that the integral curves of this system cut inside of any ellipse 3x?+y” = A, 
and as we vary the positive constant A, these ellipses fill out the entire xy-plane. It 
follows that all solutions of this system tend to (0,0), as t > oo. One says that the 
domain of attraction of the rest point (0, 0) is the entire xy-plane. 


Example 6.4.2. The system 
x’ =—-2x+y'4, 
Y=-ytx 


has a rest point (0,0). (There is one more rest point at (21/19, 25/1°).) For small |x| and 
|y|, the nonlinear terms (y* and x°>) are negligible. If we drop these nonlinear terms, 
then both of the resulting equations, x’ = —2x and y’ = —y, have all solutions tending 
to zero as t > oo. Therefore, we expect the asymptotic stability of (0,0). Choosing 
L(x, y) = x? + y*, compute 


d 

Geo: y(t)) = 2xx! + 2yy! = 2x(—2x + y*) + 2y(—y + x9) 
= —4x? — 2y? + 2xy* + 2x y < —2(x? + y?) + Axy* + 2x°y 
= —2r? + 2r> cos @sin* 6 + 2r® cos> Osin 6 < 0, 


provided that the point (x, y) belongs to a disc Bs : x? + y” < 62, with a sufficiently 
small 6, as is clear by using the polar coordinates (r is small, r < 6). Hence, any solu- 
tion, with the initial point (x(0), y(0)) in Bs and 6 sufficiently small, tends to zero as 
t > oo. The rest point (0,0) is indeed asymptotically stable. Its domain of attraction 
includes Bs, with 6 sufficiently small. (If the initial point (x(0), y(0)) is not close to the 
origin, solutions of this system will typically go to infinity in finite time.) 


234 Chapter 6. Nonlinear Systems 


Example 6.4.3. If we drop the nonlinear terms in the system, 


x Sy— 


’ P (6.4.5) 
yu-x-y, 
with a unique rest point at (0, 0), the resulting linear system 
x’ =y, 
; (6.4.6) 
y=a-x 


is equivalent to the harmonic oscillator x” + x = 0, for which all solutions are periodic 
and do not tend to zero. (The point (0,0) is a center for (@.4.6).) It is the nonlinear 
terms that make the rest point (0, 0) asymptotically stable for the original system (6.4.5). 
Indeed, taking L(x, y) = x? + y?, we have 

£ 1(x(t),y(0) = 2xx' + 2yy’ = —2x*—2y® <0, forall (x, y) # (0,0). 


The domain of attraction of the rest point (0, 0) is the entire xy-plane. 


Example 6.4.4. The system 
x’ =—-yt+y(x?4+y?), 
C : ) (6.4.7) 
y' =x—x(x?+y?) 


has a rest point (0,0). Multiply the first equation by x, the second one by y, and add 
the results. We obtain 


xx’ +yy' =0, 

d 
qe +y)=0, 
ay ae: 


The solution curves (x(t), y(t)) are circles around the origin. (If x(0) = a and y(0) = b, 
then x?(t) + y?(t) = a? + b’.) Ifa solution starts near (0, 0), it stays near (0,0), but it 
does not tend to (0, 0). In such a case, we say that the rest point (0, 0) is stable, although 
it is not asymptotically stable. 

Here is a more formal definition: a rest point (Xo, yo) of is called stable in 
the sense of Lyapunov if given any € > 0 one can find 6 > 0, so that the solution curve 
(x(t), y(t)) lies within the distance ¢ of (Xo, yo) for all t > 0, provided that (x(0), y(0)) is 
within the distance 6 of (xg, yo). Otherwise, the rest point (Xo, yo) is called unstable. In 
addition to the rest point (0, 0), the system has a whole circle x? + a = lofrest 
points. All of them are unstable, because the solutions on nearby circles move away 
from any point on x? + y* = 1. 


Example 6.4.5. The system 
x = —yps xi? +3), 
y =x+y(x? 4+’) 


has a unique rest point (0,0). Again, we multiply the first equation by x, the second 
one by y, and add the results. We obtain 


(6.4.8) 


xe yy = (x + y) . 
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Denoting p = x* + y”, we rewrite this as 


Ly 52 
2dt 
Then “ > 0, so that the function p = e(t) is increasing. Integration gives 
_ _ Po 2 2 
p(t) = I= 2pot” where Py = x*(0) + y*(0) > 0. 


Solutions do not remain near (0, 0), no matter how close to this point we start. In fact, 
solutions move infinitely far away from (0,0), as t > ae It follows that the rest point 
(0, 0) is unstable. It turns out that solutions of the system spiral out of the rest 
point (0, 0). 

To show that solutions move on spirals, we compute the derivative of the polar 
angle, 6 = tan7! ss along the solution curves. Using the chain rule, 


Pe 
dG» 5 oe V\ 1 (1), 
apo Oy Sa )x +3 (5) 


d x2 
x2 x2 
_ xy’ — yx’ 
= Sy 
x (x + p(x? + y?)) — y(-y + x(x? + y”)) 
~ x? + y? 
=1, 


so that @ = t +c. It follows that 6 - —oo as t > —oo, and the point (x(t), y(t)) moves 
ona spiral. We see that solutions of the system spiral out (counterclockwise) of 
the rest point (0, 0) (corresponding to t > —oo) and tend to infinity, as t > —. 
PO 

Example 6.4.6. For the system with three variables 

x’ =—3x+y(x*+27+4+1), 

yi =-y—2x(x2 +2741), 

Z = —z—x*z3, 
one checks that (0, 0,0) is the only rest point. We search for a Lyapunov function in 
the form L(x, y, z) = . (ax* + by* + cz”). Compute 

L 
a = axx' + byy’ +.czz’ = —3ax? + xy (x? + 22 +1) (a — 2b) — by? — cx?z4 — cz?. 

We have < < 0 for (x, y, z) # (0,0, 0), ifa = 2b. In particular, we may select b = 1,a = 
2, and c = 1 to prove that (0, 0, 0) is asymptotically stable. (Lyapunov’s theorem holds 
for systems with three or more variables too. Solutions cut inside the level surfaces of 


L(x, y, Z).) 


6.4.1 Stable Systems. Ann xn matrix A is called a stable matrix if all of its eigen- 
values are either negative or they are complex numbers with negative real parts (which 
can also be stated as Re A; < 0, for any eigenvalue of A). For a stable matrix A, all entries 
of e4* tend exponentially to zero as t > oo: 


te"). = ae (6.4.9) 


ij 


236 Chapter 6. Nonlinear Systems 


for some positive constants a and b and for all i and j. (Here (e“"), denotes the ij- 
element of e4’.) Indeed, x(t) = e4‘x(0) gives a solution of the system 
x’ = Ax, (6.4.10) 


so that e“! is the normalized fundamental solution matrix and each column of e“* is a 
solution of (6.4.10). On the other hand, each solution of contains factors of the 
type eRe4i!, as was developed in Chapter [5 justifying (6.4.9). For a stable matrix A, all 
solutions of the system x’ = Ax tend to zero, as t > oo, exponentially fast. If a matrix 
A is stable, so is its transpose A’, because the eigenvalues of A! are the same as those 
of A, and so the estimate holds for A’ too. 

We now solve the following matrix equation: given a stable matrix A, find a positive 
definite matrix B so that 


A'B+BA=-I, (6.4.11) 
where I is the identity matrix. We shall show that a solution of (6.4.11) is given by 
B= [ cAT EAL dy, (6.4.12) 
0 


By definition, to integrate a matrix, we integrate all ofits entries. In view of the estimate 

(6.4.9), all of these integrals in (6.4.12) are convergent ast > co. We have B? = B (using 
T 

that (e4) = e4"t) and 


ax = | eM tettnas = f (etx) ettxar = | \|e4*x||? dt > 0, 
0 0 0 


for any x # 0, proving that the matrix B is positive definite. (Recall that ||y|| denotes 
the length of a vector y.) Write 


ATB + BA= [ [AT eA"teAt + eA” tet] dt 
(0) 


= i” < [eA"te4*] de 


0 
a galt cat | 
0 
= —], 
as claimed (the upper limit vanishes by (6.4.9)). 
We now consider a nonlinear system 
x’ = Ax + h(x), (6.4.13) 
with a constant n x n matrix A and a column vector function 
T 
h(x) = [hy (x) hy (x) « MnO], 
where X = (Xj, X2,..., X,) (So that h(x) is a given vector function of the variables xj, x2, 
..-;X,). We assume that h(0) = 0, so that the system (6.4.13) has a trivial solution x = 0 


(x = Oisa rest point). We shall denote by ||x|| and ||h(x)|| the length of the vectors x 
and h(x), respectively. 


Theorem 6.4.2. Assume that the matrix A is stable, h(0) = 0, and 


tim Moll 9, (6.4.14) 
x0 |[xl| 
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Then the trivial solution of (6.4.13), x = 0, is asymptotically stable, so that any solution 
x(t), with ||x(0)|| small enough, satisfies lim,_,,, x(t) = 0. 


Proof. Let the positive definite matrix B be given by (6.4.12), so that (6.4.11) holds. 
The quadratic form L(x) = x7 Bx is a Lyapunov function, because L(0) = 0 and L(x) > 


0 for all x 4 0. We shall show that “L(x(t)) < 0, so that Lyapunov’s theorem applies. 
Taking the transpose of the equation (6.4.13), obtain 


(xT) = xTAT +h’. 
Using and then the condition gives 
£1020) = (xT) Bx + x7 Bx' 
= (xTAl +h?) Bx + x™B(Ax + h) 
= x" (ATB + BA)x+h"™Bx +x"™Bh 
= —||x||? + h™Bx + x7Bh <0, 


provided that ||x|| is small enough. (By (6.4.14), for any ¢ > 0, we have ||h(x)|| < ¢||x]|, 
for ||x|| small enough. Then ||h7Bx|| < ||A||||Bll||x|| < ¢||B||||x||?, and the term x7 Bh 


is estimated similarly. The norm of a matrix is defined as ||B|| = paar be; see the 
appendix.) © 
6.5 Limit Cycles 
We consider the system (with x = x(t), y = y(t)) 
x'= f(x,y), x(0) = Xo, 
(6.5.1) 


y= g(x,y), yO) = Yo. 
Here f(x, y) and g(x, y) are given differentiable functions. Observe that these functions 
do not change with t (unlike f(t,x,y) and g(t,x,y)). Systems like are called 
autonomous. The initial point (xo, 9) is also given. By the existence and uniqueness 
theorem, Theorem this problem has a solution (x(t), y(t)), which defines a curve 
(a trajectory) in the (x, y)-plane, parameterized by t. If this curve is closed, we call the 
solution a limit cycle. (The functions x(t) and y(t) are then periodic.) If (x(t), y(t)) is 
a solution of (6.5.1), the same is true for (x(t — a), y(t — a)), where a is any number. 
Indeed, (x(t), y(t)) satisfies the system at any ¢ and in particular at t — a. 


Example 6.5.1. One verifies directly that the unit circle x = cost, y = sint is a limit 
cycle for the system 
x’ =-y+x(1-x?-y’), 
yi =x+y(1—x?-y?). 
To see the dynamical significance of this limit cycle, we multiply the first equation by 


x, the second one by y, add the results, and call p = x + y* > 0(p is the square of the 
distance from the point (x, y) to the origin). We obtain 


(6.5.2) 


50 = p(1—p). (6.5.3) 
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The origin (0, 0) is a rest point of (6.5.2), corresponding to the rest point p = 0 of (6.5.3). 
The equation also has a rest point p = 1, corresponding to the limit cycle x = 
cost, y = sint. When 0 < p < 1, it follows from the equation that p(t) > O and 
p(t) is increasing. When p > 1, e’(t) < 0 and p(t) is decreasing. It follows that p(t) > 1 
as t > oo for all solutions of (with p(0) > 0). We conclude that all solutions 
of tend to the limit cycle, which is called asymptotically orbitally stable. Notice 
that asymptotic orbital stability does not imply asymptotic stability (which means that 
all solutions, starting sufficiently close to some solution, tend to it as t > oo). Indeed, 
a solution tending to the unit circle may tend to x = cos(t — a), y = sin(t — a) for some 
0 < a < 27, instead of x = cost, y = sint. 

The vector field F(x,y) = (f(x, y), g(x, y)) is tangent to the solution curves of 
(6.5.1), and so F(x, y) gives the direction in which the solution curve travels at the 
point (x, y) (observe that F(x, y) = (x’, y’), the velocity). 


The following classical theorem gives conditions for the existence of a stable limit 
cycle. 


y 
4 
C2 
D 
Cy ( ) 
~X 
The trapping region D. 


6.5.1 Poincaré-Bendixson Theorem. Suppose that D is a region of the xy-plane 
lying between two simple closed curves C, and C3. Assume that the system has no 
rest points in D and that at all points of C, and Cy the vector field F(x, y) points toward 
the interior of D. Then has a limit cycle inside of D. Moreover, each trajectory of 
(6.5.1), originating in D, is either a limit cycle or it tends to a limit cycle, which is contained 
in D. 

A proof can be found in I. G. Petrovskii [22]. The region D is often called the 
trapping region. 

For practice, let us apply the Poincaré-Bendixson theorem to the system 
(we already know that x = cost, y = sint is a limit cycle). One checks that (0,0) 
is the only rest point. (Setting the right-hand sides of to zero, one gets y/x = 
—x/y, so that x = y = 0.) Let C, be the circle of radius 1/2 around the origin, C, the 
circle of radius 2 around the origin, and D the region between them. On Ci, F(x, y) = 
(-» + =x, x + y). The scalar product of this vector with (x, y) is =x? + =~ > 0. 
Hence, F(x, y) points outside of C; and into D. On C,, F(x, y) = (—y — 3x, x — 3y). 
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The scalar product of this vector with (x, y) is —3x? — 3y” < 0, and F(x, y) points into 
D. We conclude that there is a limit cycle in D, confirming what we already know. 


Example 6.5.2. To model oscillations connected to glycolysis (the process of cells break- 
ing down sugar to obtain energy) the following model was proposed by E. E. Sel’kov 
[28]: 
x’ =-x+ay+xy, 
P : (6.5.4) 
y' =b-ay-x*y. 
Here a and b are positive parameters. The unknown functions x(t) and y(t) represent 
some biological quantities and are also assumed to be positive. 


J 


The trapping region D \ D, (D, is the disc inside C,). 


To prove the existence of a limit cycle, we shall construct a trapping region. Con- 
sider the four-sided polygon D in the xy-plane bounded by part of the x-axis, 0 < x < 


b+ °, by part of the y-axis,0 < y < °, by the horizontal line y = °, with 0 < x <b, 
and finally by the line x+y = b+ °.; see the figure. We claim that the vector field of this 
system, F(x, y) = (—x +ax+x’y,b-ay— xy), points inside of D, on the boundary 
of D. Indeed, y’ > 0 when y = 0 (on the lower side) and the trajectories go up, y’ < 0 
when y = - (on the upper side) and the trajectories go down. On the left side, x = 0, 
we have x’ > 0, and the trajectories travel to the right. Turning to the right-hand side, 
observe that by adding the equations in (6.5.4), we get 
(x+y) =b-—x<0, forx>b. 
Hence, the trajectories travel from the line x + y = b+ : (the right side) toward the 
a 


lines x +y =c, withe < b+ un which corresponds to the interior of D. 
a 
We now look for the rest points. Setting the right-hand side of the first equation to 


sites : b 
zero, we get y = om Similarly, from the second equation, y = aan We conclude 


— ) lies inside D. To deter- 
a 


mine the stability of this rest point, we consider its linearized system, with the Jacobian 


thatx = bandy = — < °. The only rest point (b, 
a a 
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KcQy) fy y) 


matrix A = 
8x(x%,y) gy(x,y) 


: ae 
evaluated at the rest point (b, aa : 


—2xy -a-— x? b? ee 
b2+a 


=2 


b2 
Pere atm || _| +257 a+b? 
(3232) 
The eigenvalues of A satisfy 1,/, = detA =a+b*>0,4, +4, =trA. If 


b* + (2a—1)b?+a+ a? 
b*+a 
then A, and A, are either both positive or both are complex numbers with positive real 


trA= 


> 0, (6.5.5) 


. b ‘ 5 
parts. In the first case, the rest point (b, ee is an unstable node, and in the second 
a 


case it is an unstable spiral, for both the linearized system and for (6.5.4), in view of 
the Hartman-Grobman theorem. Hence, on a small circle C, around the rest point, 
bounding the disc we call Dj, trajectories point out of D, (outside of C,). Let now D 
denote the region D, with the disc D, removed, D = D \ D,. Then, under the condition 
(6.5.5), D is a trapping region, and by the Poincaré-Bendixson theorem there exists a 


stable limit cycle of (6.5.4), lying in D. 
The condition is equivalent to 
b* — b* — 2ab? —a—a? > 0, 


which holds if b is small and a is even smaller. Still this result is biologically signifi- 
cant. Computations show that the limit cycle is unique, and it attracts all trajectories 
originating in the first quadrant of the xy-plane. In Figure 6.2 we present Mathemat- 
ica’s computation of the limit cycle (thick) for the Sel’kov system (6.5.4), with a = 0.07, 


2.5 


2.0 - 


0.5- 


0.5 1.0 1.5 2.0 2.5 3.0 


Figure 6.2. The limit cycle of the Sel’kov system 
for a = 0.07, b = 0.5. 
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b = 0.5. One sees that the trajectories both on the inside and on outside of the limit 
cycle converge quickly to it. The rest point at (0.5, 1.5625) is marked. 

Sometimes one wishes to prove that limit cycles do not exist in some region. Recall 
that a region is called simply connected if it has no holes. 


6.5.2 Dulac-Bendixson Criterion. Assume that f(x,y), f(x, y), and g,(x, y) are 
continuous in some simply connected region R of the xy-plane and that 


fc(%, y) + gy(x, y) 


does not change sign on R (it is either positive for all points in R or negative everywhere on 
R). Then the system (6.5.1) has no closed trajectories inside R. 


Proof. Any solution (x(t), y(t)) of (6.5.1), for a < t < b, determines a curve C (or a 
trajectory) in the xy-plane. We evaluate the following line integral: 


b 


[ g(x,y) dx — f(x,y) dy = ) [g(x(t), y(t))x'(t) — Fc), Y))y'()] dt = 0, (6.5.6) 
c a 


using the equations (6.5.1). If (x(t), y(t)) is a limit cycle inside R, then (6.5.6) holds; 
moreover, the curve C is closed, and it encloses some region P inside R. By Green’s 
formula, the line integral 


[ senax—senay=- ff [kon +ayoy]aa 

c P 

is either positive or negative, contradicting (6.5.4). © 
Exactly the same proof produces a more general result. 


Theorem 6.5.1 (Dulac-Bendixson Criterion). Assume that f(x, y), f(x, y), and g,(x, y) 
are continuous in some simply connected region R of the xy-plane and there is a differen- 
tiable function h(x, y), which is positive on R, so that 


Flax fous] + F aCe yg 9) (6.5.7) 


does not change sign on R. Then the system (6.5.1) has no closed trajectories inside R. 


Example 6.5.3. The Lotka-Volterra model of two competing species 
x' = x(a—bx-cy), CoS 
o 2s 
y =y(d—ex—ky), 


with positive constants a,b,c,d,e, and k, has no limit cycles in the first quadrant of the 
xy-plane. Indeed, select h(x,y) = — > 0 for x,y > 0. Then the expression 
xy 


becomes 


0 (=). fe) (—A=*)--3-F <o 


ax y dy x y x 
for x,y > 0. It follows that the system has no limit cycles in the first quadrant of 
the xy-plane. 
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6.6 Periodic Population Models 


Population models become much harder to analyze in case the coefficients vary with 
time t. However, if all coefficients are periodic functions of the same period, it is still 
possible to obtain a detailed description of the solutions. 

We begin by considering the logistic equation 


x' = x(a(t) — b(t)x), (6.6.1) 


modeling the number of rabbits x(t) at time t. We are only interested in positive solu- 
tions, x(t) > 0 for all t. The given continuous functions a(t) and b(t) are assumed to 
be periodic, with the period p, so that a(t + p) = a(t) and b(t + p) = b(t) for all t. The 
periodicity of a(t) and b(t) can be attributed to seasonal variations. For example, the 
carrying capacity a(t) is likely to be higher in summer and lower, or even negative, in 
winter. We assume that the average value of a(t) is positive, so that 


p 
[ a(s)ds > 0 (6.6.2) 
0 


and that the self-limitation coefficient b(t) satisfies 
b(t)>0, for all t. (6.6.3) 
This equation is of Bernoulli’s type. We divide it by x”, 


and set y = 1 Then y= = and we obtain a linear equation 
x x2 
y’ + a(t)y = b(t) (6.6.4) 


that is easy to analyze. 


Lemma 6.6.1. The problem has a positive solution of period p. This solution is 
unique, and it attracts all other solutions of (6.6.4), as t > oo. 


Proof. With the integrating factor u = elo (5)48, the solution of (6.6.4), satisfying an 
initial condition y(0) = yo, is found as follows: 


& [u(e)O] = HOBO, 


t 
1 1 
(t) = — yo + =a | (s)b(s) ds. 
me BO” BO Jy” 

This solution is periodic, provided that y(p) = y(0) = yo (as justified in the Problems), 
implying that 

Y= io + or | " (s)o(s)as 

°™ epy? * up) J, 
which we write as é 
Gu() = Dy» =f H(596(5) a 
0 

Since (p) > 1 (by the assumption (6.6.2), we can solve this equation for yo, 


1 


OG 


Pp 
[ L(s)b(s) ds > 0, 
0 
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obtaining the initial value yg, which leads to a positive solution y(t) of period p. 
If z(t) is another solution of (6.6.4), the difference w(t) = z(t) — y(t) satisfies 


w’ + a(t)w = 0. 


Integrating, w(t) = e7 fo as) 4510) — 0, as t > oo (by the assumption (6.6.2), proving 
that all solutions tend to y(t). In particular, this fact implies that the periodic solution 
y(t) is unique. © 


This lemma makes possible the following complete description of the dynamics 
for the logistic equation. 


Theorem 6.6.1. Assume that the continuous p-periodic functions a(t), b(t) satisfy the 


conditions and (6.6.3). Then the equation has a positive solution of period 
p. This solution is unique, and it attracts all other positive solutions of (6.6.1), as t > oo. 


Proof. By Lemma there is a positive p-periodic solution y(t) of (6.6.4). Then 

a= a gives a positive p-periodic solution of (6.6.1). If z(t) is another positive 
y 

solution of (6.6.1), then the same lemma tells us that ee 0 ast > ow, which 


x(t) z(t) 
implies that x(t) — z(t) > Oast — oo. (Observe that z(t) is bounded. Indeed, it 


follows from the equation (6.6.1) that z(t) is decreasing for large enough z, so that 


a(t) — b(t)z < 0, which holds if z > maa) Then z < neEae) It follows that the 
min D(t) min D(t) 
p-periodic solution x(t) attracts all other positive solutions of (6.6.1), and there is only 


one p-periodic solution. © 


The following corollary says that an increase in carrying capacity will increase the 
p-periodic solution of (6.6.1]). This is natural, because the p-periodic solution attracts 
all other solutions (“a rising tide lifts all boats”). 


Corollary 6.6.1. Let x,(t) be the positive p-periodic solution of 
X1 = X,(a;(t) — B(t)x}), 


where the p-periodic function a;(t) satisfies a,(t) > a(t) for all t. Then x,(t) > x(t) for 
all t (x(t) is the positive p-periodic solution of (6.6.1)). Moreover, if a;(t) is close to a(t), 
then x,(t) is close to x(t). 


Proof. Set y, = - andy = +. As before, y’ + a(t)y = b(t), and 
xX x 


yi +a, (ty, = b(t). 
Let z(t) = y(t) — y(t). Then z(t) is a p-periodic solution of 
z’ + a(t)z = (a,(t) — a(t))y, (t) > 0. (6.6.5) 


By Lemma the periodic solution of this equation is positive, so that z(t) > 0 for 
all t, and then y(t) > y,(t), which implies that x(t) < x(t) for all t. 

Turning to the second statement, we are now given that the right-hand side of 
is small. Going over the construction of the p-periodic solution in Lemma 
we see that z(t) is small as well. © 
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We consider next another model for a population x(t) > 0 of rabbits 
x’ = x(x — a(t)) (b(t) — x). (6.6.6) 


The given continuous functions a(t) and b(t) are assumed to be positive, periodic with 
period p, and satisfying 0 < a(t) < b(t) for all t. If0 < x(t) < a(t), it follows from the 
equation that x’(t) < 0 and x(t) decreases. When a(t) < x(t) < b(t), the population 
grows, so that a(t) gives a threshold for population growth. (If the number of rabbits 
falls too low, they have a problem meeting the “significant others”.) 
Let us assume additionally that the maximum value of a(t) lies below the mini- 
mum value of b(t): 
max a(t)< min D(t). (6.6.7) 
—w<t<oo —o<t<oo 
Theorem 6.6.2. [f a(t) and b(t) are continuous p-periodic functions satisfying (6.6.7), 
then the equation has exactly two positive solutions of period p. 


Proof. We denote by x(t, x9) the solution of (6.6.4), satisfying the initial condition 
x(0) = Xg, so that x(0, x9) = Xg. To prove the existence of two solutions, we define the 
Poincaré map xy > T(Xo), by setting T(x9) = x(p, x9). The function T(x) is continu- 
ous (by the continuous dependence of solutions, with respect to the initial condition). 
Define the numbers A = min_.cte., b(t) -—€, B = Max_ ete D(t)+¢, and the interval 
I = (A, B). Ife > Ois chosen so small that max_.ocpeo, A(t) < MiIN_. e+eo9 D(t) — €, then 
we claim that the map T takes the interval J into itself. Indeed, if x9 = A, then from the 
equation, x’(0) > 0, and x(t, x9) is increasing, for small t. At future times, the solution 
curve cannot cross below x9, because again we have x'(t) > 0, if x(t) = x9. It follows 
that x(p, Xo) > Xo, or T(A) > A. Similarly, we show that T(B) < B. The continuous 
function T(x) — x is positive at x = A and negative at x = B. By the intermediate 
value theorem T(x) — x has a root x on the interval I = (A, B), so that there is a fixed 
point x such that T(x) = x. Then x(p, x) = x, which implies that x(t, x) is a p-periodic 
solution. 

The second periodic solution is obtained by considering the map T,, defined by 
setting T\(x9) = x(—p,Xo), corresponding to solving the equation backward 
in time. As in the case of T, we see that T, is a continuous map, taking the interval 
T, = (Min_ yepego A(t) — €, MAX_ycpeg A(t) + €) into itself (for small ¢ > 0). T; has a 
fixed point on I), giving us the second p-periodic solution, so that the equation 
has at least two positive p-periodic solutions. 

To prove that there are at most two positive p-periodic solutions of (6.6.6), we need 
the following two lemmas, which are also of independent interest. 


Lemma 6.6.2. Consider the equation (for w(t)) 
w’ = c(t)u, (6.6.8) 


with a given continuous p-periodic function c(t). This equation has a nonzero p-periodic 
solution if and only if 
D 
[ c(s) ds = 0. 
0 
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Proof. Integrating the equation gives w(t) = w(o)e% c(s) ds Using the period- 
icity of c(t), we see that 
w(t + p) = woe” c(s) ds 

- w(0)e/ c(s) ds+yitP c(s) ds 

= w(o)e/ c(s) ds ole c(s) ds 
w(o)e c(s) ds 
= w(t), 


exactly when ri c(s) ds = 0. ° 


II 


Lemma 6.6.3. Consider the nonlinear equation (with a continuous function f(t, x), 
which is twice differentiable in x) 


x' = f(t,x). (6.6.9) 
Assume that the function f(t, x) is p-periodic in t and convex in x: 
f(t + p,x) = f(t), forall t and for x > 0, 
Fex(ts x) > 0, for all t and for x > 0. 


Then the equation has at most two positive p-periodic solutions. 


Proof: Assume, to the contrary, that we have three positive p-periodic solutions: x,(t) 
< x,(t) < x;(t) (solutions of do not intersect, by the existence and uniqueness 
theorem). Set w,; = x, —x, and w, = x3 —X2. These functions are p-periodic, and they 
satisfy 


1 
wi = f(t) — fed = [ef (ex +0 Om d0 
0 


1 
= i tc (t, Ox2 + (1 — 0)x1) dé w, = c, (tu, 
0 
1 


wh = fbx) — Flt) = [Hef t.8x5 +(x) d0 
0 


1 
= [ FS. (t, 8x3 + (1 — 0)x2) dO wz = c,(t)W>. 
0 


(We denoted by c)(t) and c,(t) the corresponding integrals.) The function f, is increas- 
ing in x (because f,, > 0). It follows that c,(t) > c,(f) for all t, and so c,(t) and 
c(t) cannot both satisfy the condition of Lemma We have a contradiction to 
Lemma (Observe that w,(t) and w,(t) are p-periodic solutions of the equations 
W, = Cy (t)w, and w, = c2(t)w.) © 


Returning to the proof of the theorem, we rewrite (6.6.6) as 
x! = —x3 + (a(t) + b(t))x? — a(t)b(t)x. 
Divide by x: 


X14 GO+EO) _ alNbO) 
x x x 
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1 ; 
We set here u = => 80 that u’ = —2x~3x', and obtain 
x 


u’ = 2— 2(a(t) + b(t) Vu + 2a(t)b(t)u. (6.6.10) 


Clearly, the positive p-periodic solutions of the equations and are in one- 
to-one correspondence. But the right-hand side in (6.6.10) is convex in u. By Lemma 
both of the equations and have at most two positive p-periodic 
solutions. It follows that the equation has exactly two positive p-periodic solu- 
tions. ° 


Let x;(t) < x2(t) denote the two positive p-periodic solutions of (6.6.6), provided 
by the above theorem, and let x(t, x9) denote again the solution of this equation, with 
the initial condition x(0) = xo. It is not hard to show that x(t, x9) > x(t) ast > oo if 
Xg belongs to either one of the intervals (x(0), co) or (x,(0), x2(0)). On the other hand, 
X(t,X9) > Oast > co if xp € (0, x,(0)), so that the larger p-periodic solution x(t) is 
asymptotically stable, while the smaller one xj(t) is unstable. 


Competing Species. We consider next the case of two competing species, with the 
populations x(t) and y(t), satisfying the Lotka-Volterra system 

x’ = x(a(t) — bx —cy), 

y' = y(d(t) — ex — fy). 
The given functions a(t) and d(t) are assumed to be periodic, with the period p, so that 
a(t + p) = a(t) and d(t + p) = d(t) for all t. We do not assume a(t) and d(t) to be 
positive but assume that they have positive averages over (0, p). The positive numbers 
b,c, e, and f are given. As before, the periodicity of a(t) and d(t) may be attributed to 
seasonal variations. The numbers c and e are called the interaction coefficients. They 
quantify how detrimental the species are for each other. It seems reasonable to assume 
that the self-limitation coefficients b and f, as well as the interaction coefficients c and 
e, change less with the seasons than the carrying capacities, and so we assumed them 
to be constants in this model. 

We may regard the first equation as a logistic equation for x(t), with the carrying 
capacity equal to a(t)—cy(t). We see that each species in effect diminishes the carrying 
capacity of the other one, as they compete for food, hiding places, etc. The largest 
population of the first species occurs if the second one goes extinct, so that y(t) = 0 for 
all t. Then the first equation becomes 


x’ = x(a(t) — bx). (6.6.12) 


By Theorem this equation has a unique positive p-periodic solution, which we 
denote by X(t). The pair (X(t), 0) is a p-periodic solution of our system (6.6.11), called 
a semitrivial solution. If Y(t) denotes the unique positive p-periodic solution of 


y' = y(d(t) — fy), (6.6.13) 
then (0, Y(t)) is the other semitrivial solution. 


The following theorem describes a case when the dynamics of the Lotka-Volterra 
system is similar to that of a single logistic equation. 


(6.6.11) 


Theorem 6.6.3. Denoting A = fe a(t)dt, D= fe d(t) dt, assume that A > 0, D > 0, 
and 
fA-cD>0 and bD-eA>O. (6.6.14) 
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Then the system (6.6.11) has a unique positive (in both components) p-periodic solution, 
to which all other positive solutions of (6.6.11) tend, as t > oo. 


Proof. The largest possible periodic solutions X(t) and Y(t) (defined by (6.6.12) and 
(6.6.13})) occur when the competitor species is extinct. Denote by &(t) the positive p- 
periodic solution of the logistic equation 


x’ = x(a(t) — bx — cY(t)). 


Here the first species is forced to compete with the maximal periodic solution for the 
second species. Similarly, we denote by n(t) the positive p-periodic solution of the 
logistic equation 
y’ = y(d(t) — eX — fy). 

(To prove the existence of &(t), we need to show that ss (a(t) — cY(t)) dt > 0. Dividing 
the equation Y’ = Y(d(t) — fY) by Y and integrating, we have i Y(t)dt = 2. Then 
fe (a(t) —cY(t)) dt = A- 8 > 0, by the first condition in (6.6.14). The existence of 
7(t) is proved similarly.) 

We shall construct a p-periodic solution of our system (6.6.11) as the limit of the 
p-periodic approximations (x,, y,,), defined as follows: x, = X(t), y, = n(t), while 
(x2(t), y2(t)) are respectively the p-periodic solutions of the following two logistic equa- 
tions: 


X5 = X7(a(t) — bx, — cy,), 
Ya = y2(d(t) — ex, — fy2), 


so that we compute x,(t) and immediately use it to compute y,(t). Using Corollary 


we see that 
xX2(t)<x,(t) and y,(t) < y2(t) for all t. 


(Or think “ecologically”: x, is computed when the first species faces some competi- 
tion, while x, = X(t) was computed without competition, so that x(t) < x,(t); y2 is 
computed when the second species faces weaker competition than when y, was com- 
puted, so that y(t) < y,(t).) In general, once (x,(t), y,(t)) is computed, we obtain 
(Xn41(t), Yn41()) by finding the p-periodic solutions of the logistic equations 


Xn+1 fact Xn+1(a(t) = DXnqi = CYn)> 


1 (6.6.15) 
Yn+1 = Yn41(d(t) — eXn41 — SYn+1): 


By the same reasoning as above, we show that for all t 


E(t) < Xp(t) < ++» < xQ(t) < x(t) and yy(t) < yo(t) < -+- < y(t) < Y(t). 


At each t, x,(t) is a monotone and bounded sequence of numbers, which has a limit. 
We denote xp(t) = lim,_,.. X,(¢) and similarly y,(t) = lim,.,,, yn(t). Passing to the 
limit in the equations (or rather in their integral versions), we see that 
(xp(t), Yp(t)) is a positive p-periodic solution of (6.6.11). 

Next, we prove that there is only one positive p-periodic solution of (6.6.11). Let 
(x(t), y(t)) be any positive p-periodic solution of (6.6.11]). We divide the first equation 
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in (6.6.11) by x(t) and integrate over (0, p). By periodicity, ie dt = In x(t)|p =0. 
Then 


p D 
bf x(t) dt + cf y(t) dt =A. 
0 0 
Similarly, from the second equation in (6.6.11) 


p p 
ef xndrs f [ y(t) dt = D. 
0 0 


Solving these two equations for the integrals, we get 


? fA=—eD ? bD—eA 
; x(t = F—s > 0. [ y(t) dt = F——E > 0. (6.6.16) 
(Observe that our conditions imply that bf — ec > 0.) Let now (X(t), y(t)) be 
another positive p-periodic solution of (6.6.11). Clearly, x(t) < x,(t) = X(t), p(t) > 
y(t) = n(t). We prove inductively that x(t) < x,(t) and y(t) > y,(t). Letting n > o, 
we have x(t) < x,(t) and p(t) > yp(t). Since by 


p p p p 
[ Xp(t) dt = [ xX(t)dt and [ Yp(t) dt = [ y(t) dt, 
0 0 0 0 


we conclude that x(¢) = xp(t) and y(t) = yp(t). 

Turning to the stability of (xp(), yp(¢)), we now define another sequence of iter- 
ates (%,,,,). Beginning with %, = &(t), j; = Y(t), once the iterate (%,,(t), f,,(t)) is 
computed, we obtain (%),41(t), ¥,41(t)) by calculating the p-periodic solutions of the 
following two logistic equations: 


Dnt = In+i1(d(o) — ey, — fIn+1) 

Kina = Fn41(a) — b&n41 — Pn4i) 
(so that we compute },,,;(t) and immediately use it to compute %,,,,(t)). By the same 
reasoning as above, we show that for all n 


Ry < By <5 < Ry < X(t) < + < XA (t) < x4) 
and 
yilt) < Yat) < + < Yn) < In <<) < HO. 
As before, (%,,9,) tends to a positive p-periodic solution of (6.6.11), which by the 


uniqueness must be (xp(t), yp)(t)). We conclude that the periodic solution is approxi- 
mated from both below and above by the monotone sequences, xp(t) = limp... Xn(t) = 


limp 0. p(t) and p(t) = limp oo Yn(t) = limp oo In(t). 

Next, we sketch a proof that any positive solution, (x(t), y(t)) of (6.6.11), tends to 
the unique positive p-periodic solution (xp(t), yp(t)), as t > oo. The idea is to show 
inductively that for any integer n and any € > 0 


R(t) -e<x(t)<x,()+e and y,(t)-—¢€< yt) <y,(t) +¢, (6.6.17) 
for t large enough. Indeed, the inequality y,,(t) — ¢ < y(t) implies that 
x’ < x(a(t) — bx — cy, + ce). 
Then x(t) lies below the solution of 


x’ = x(a(t) — bx — cy, + ce), (6.6.18) 
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with the same initial condition. Any positive solution of tends to the p-periodic 
solution of that equation, which, by Corollary is close to the p-periodic solution 
of 


x’ = x(a(t) — bx —cy,), 


or close to X,,41, So that the estimate of y(t) from below in (6.6.17) leads to the estimate 


of x(t) from above in (6.6.17), at n + 1. This way we establish the inequalities (6.6.17) 
at the next value of n. © 


This theorem appeared first in the author’s paper [[17]]. The idea to use monotone 
iterations, to prove that all positive solutions tend to the periodic one, is due to E. N. 
Dancer (7, who used it in another context. 


6.6.1 Problems. 
I. 1. () Find and classify the rest points of 
x'(t) = x(x + 1)(x — 2). 
Hint. The sign of x’(t) changes at x = —1,x = 0, and x = 2. 


Answer. The rest points are x = —1 (unstable), x = 0(stable), and x = 2 
(unstable). 


(ii) Let y(t) be the solution of 
YO=yV+)OY-2), yO) = 3. 
Find lim,_,,, y(t) and lim,_,_., y(t). 
Answer. co and 2. 
(iii) What is the domain of attraction of the rest point x = 0? 
Answer. (—1, 2). 
2. Consider a population model with a threshold for growth 
x’ = x(x —1)(5— x). 


(i) Find and classify the rest points. 


Answer. The rest points are x = 0 (stable), x = 1 (unstable), and x = 5 
(stable). 


(ii) Calculate lim,_,,, x(t) for the following cases: 
(a) x(0) € (0,1). 
(b) x(O) > 1. 


Answer. (a) lim;_,,, x(t) = 0. 
(b) lim;,_,.. x(t) = 5. 
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3. (i) Find and classify the rest points of 


x’ = x?(2 — x). 


Answer. The rest points are x = 2 (stable) and x = 0 (neither stable nor 
unstable). 


(ii) Calculate lim,;_,,, x(t) for the following cases: 
(a) x(0) < 0. 
(b) x(0) > 0. 


Answer. (a) lim;_,.. x(t) = 0. 
(b) lim,.,,, x(t) = 2. 


4. (i) Find and classify the rest point(s) of 


x! = —x?, 


(ii) Solve this equation to show that lim,_,,, x(t) = 0, for any value of x(0). 
5. (i) Show that the rest point (0, 0) is asymptotically stable for the system 


Xy = 2x, +X. + XX, 
x5 =X, — 2x, + x}. 
(ii) Find the general solution of the corresponding linearized system 
Xx, = —2X1 + Xp, 
X54 =X, — 2X, 
and discuss its behavior as t > oo. 
6. Show that the rest point (0, 0) is asymptotically stable for the system 
x’ = —5y — x(x? + y), 
y =x—-yx? +y") 


and its domain of attraction is the entire xy-plane. 
Hint. Use L(x, y) = =x? +y?. 


7. (i) The equation (for y = y(t)) 
y =y(1—y) 
has the rest points y = 0 and y = 1. Discuss their Lyapunov stability. 


Answer. y = 1is asymptotically stable; y = 0 is unstable. 


(ii) Find lim;_,,, y(t) in the following cases: 
(a) y(0) <0. 
(b) 0 < y(0) <1. 
(c) yO) > 1. 
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Answer. (a) lim,_,,, y(t) = 0. 
(b) LiM 400 y(t) =1. 
(c) limo y(t) =1. 


8. Show that the rest point (0, 0) is stable, but not asymptotically stable, for the 
system 


Hint. Use L(x, y) = =x! +y?. 


9. (i) Convert the nonlinear equation 


y"+fOy' +y=0 


into a system, by letting y = x, and y’ = xp. 


Answer. 


X_ = —Xy — f(%1)x2. 


(ii) Show that the rest point (0,0) of this system is asymptotically stable, 
provided that f(x,) > 0 for all x; # 0. What does this imply for the 
original equation? 


1 1 
Hint. Use L = =x? + =x. 
2 2 


10. Show that the rest point (0, 0) is asymptotically stable for the system 


x 


1 = X2, 
2 = —8(%1) — fx) x2, 


provided that f(x,) > 0 and x,g(x,) > 0 for all x, #0. 


x 


Hint. Use L = fe g(s)ds+ ~x3. Observe that L(x, x2) > 0, for all (x,,x2) # 
(0, 0). 


What conclusion can one draw for the equation 
Yo PID FEO) =O? 
11. Consider the system 
x' =-x3 + 4y(z* +1), 
y =-y—x(z? +1), 
4,3 


z= -Z—X"°Z. 


(i) Show that (0, 0, 0) is the only rest point and it is asymptotically stable. 


252 Chapter 6. Nonlinear Systems 


(ii) If we drop the nonlinear terms, we get a linear system 


x’ =A4y, 
yl =—x, 
z= -Z 


Show that any solution of this system moves on an elliptic cylinder and 
it tends to the xy-plane, as f > oo. Conclude that the rest point (0, 0, 0) 
is not asymptotically stable. Is it stable? 


12. (i) Show that the rest point (0, 0, 0) is Lyapunov stable, but not asymptoti- 
cally stable for the system 


Xp = XQ +X34+XX3, 
X4 = —-X, + X3- 2X1X3, (6.6.19) 
X% = —Xy — Xp + XX. 


Hint. Solutions of lie on spheres xf + x3 + x3 = c (where c = 
x1(0) + 3(0) + x3(0)). 


(ii) Find all of the rest points of (6.6.19). 


Hint. Consider the 3 x 3 algebraic system obtained by setting the right- 
hand sides of to zero. If one of the variables is zero, so are the 
other two. In case x; # 0, x, # 0, and x3 ¥ 0, obtain a linear system 
ee . : 1 1 Ts gangs 
with infinitely many solutions for y, = —, y. = —, y; = — dividing 
xX) X2 x3 
the first equation by x23, the second one by x,x3, and the third one by 
X1X3. 


Answer. (X1,X2,X3) = (1, =, —), where t is arbitrary, butt 41,t # 
1 


2 
13. Show that the rest point (1, 1) is asymptotically stable for the system 


ul 


x =—-3x-yrxyt3, 


, 


yl =-2x-yt+x7242. 
Hint. Set x = X +1, y = X +1 to get a system for (X, Y). 


II. 1. Show that for any positive solution of the system 
x’ =x(5—-x-2y), 
y S~easK=y) 
we have lim,_,,,(x(t), y(t) = (5, 0). 
2. Show that for any positive solution of the system 
a 1 
x = xX (2 x 5 y) ; 
y =yGrxr=y) 
we have lim;_,..(x(t), y(t)) = (1, 2). 
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3. Find lim,_,,,(x(), y(t)) for the initial value problem 
x’ =x(3-x-y), xO)= >, 
yi =y(4—2x—-y), yO)= : 
What if the initial conditions are x(0) = 0.1 and y(0) = 3? 


Answer. (3,0). For the other initial conditions: (0, 4). 


4. Discuss the long-term behavior (as t > oo) of positive solutions of the system 
x’ =x(3-x-y), 
y= y(4—2x—y). 


5. Show that any solution with x(0) > 0 and y(0) > 0 satisfies x(t) > 0 and 
y(t) > 0 for all t > 0, and then discuss the long-term behavior of positive 
solutions of the system 


x’ =x(6—3x—2y), 
y’ =y(2- avy). 
Hint. The second null-cline is a parabola, but the same analysis applies. 


Answer. Any positive solution satisfies lim,_,,, x(t) = 6— 2/7 and lim,_,,, y(t) 


= 3/7-6. 


Ill. 


_" 


. Show that the ellipse x = 2cost, y = sint is a stable limit cycle for the system 
x= -2y +x(1 = 77 -¥), 
y= sety(1- 7” -¥), 
Hint. Show that p = 2x? + y’ satisfies p’ = 2e(1 — p). 
2. Consider the system 
x =x-y—x3, 


y=ax+ty-y. 
(i) Show that the origin (0, 0) is the only rest point. 


Hint. Show that the curves x—y—x? = 0and x+y—y* = Ointersect only 
at the origin. This can be done either by hand or (better) by computer. 


(ii) Show that the origin (0, 0) is an unstable spiral. 
(iii) Show that the system has a limit cycle. 
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Hint. Compute the scalar product of F = (x — y— x3,x+y—y?) and 
the vector (x, y) and then switch to the polar coordinates. We obtain 
e+y—xt-ytaxr4ey—(x2 +9?) + 2x27? 
= 7? —r4 + 2r+ cos? O sin” 6 
<r— sr <0, for r large. 
Conclude that the annulus p? < x* + y? < R? is a trapping region, 


provided that ep > 0 is small and R > 0 is large. Apply the Poincaré- 
Bendixson theorem. 


. Show that the system 


x’ =x(2-x-y’%), 
y’ = y(4x — 3y — x?) 
has no limit cycles in the positive quadrant x,y > 0. 


Hint. Use Theorem with h(x, y) = —. 
xy 


. Show that the equation (for x = x(t)) 


x” + f(x)x’ + g(x) =0 
has no periodic solutions, provided that either f(x) > 0 or f(x) < 0, for all 
real x. 


Hint. Periodic solutions would imply limit cycles for the corresponding sys- 
tem (for x; = x and xz = x’). Use the Dulac-Bendixson criterion. 


. Show that the condition (6.5.5) holds, provided that a < - and b? lies between 


the roots of the quadratic x? + (2a—1)x +a+a?. 


. Consider a gradient system 


x, = —VY (x1, X2), 
oe (6.6.20) 

X2 = —Vy,(%1, X2), 
where V(x}, Xz) isa given twice differentiable function. (Denoting x = (xj, x2) 
and V = V(x), one may write this system in the gradient form x’ = —VV(x).) 


(i) Show that a point P = (x?, x2) is a rest point of if and only if P 
is a critical point of V(x), x2). 
(ii) Show that V(x,(t), x2(t)) is a strictly decreasing function of t for any 
solution (x,(t), x2(t)), except if (x,(t), x2(t)) is a rest point. 
(iii) Show that no limit cycles are possible for gradient system (6.6.20). 
(iv) Let (a,b) be a point of strict local minimum of V(x), x). Show that 
(a, b) is an asymptotically stable rest point of (6.6.20). 


Hint. Use L(x,, X2) = V(x1, X2) — V(a, b) as Lyapunov’s function. 


(v) Show that the existence and uniqueness theorem, Theorem .1.1applies 
to (6.6.20). 
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7. Consider a Hamiltonian system 


xy = Vy, 0%, X2), 


: (6.6.21) 
2 


X2 = Vy, (1) Xa), 


where V(x}, X2) is a given twice differentiable function. 
(i) Show that 


V(x (t), x2(t)) = constant, 


for any solution (x(t), x2(t)). 

(ii) Show that a point P = (x?, x2) is a rest point of if and only if P 
is a critical point of V(x), x). 

(iii) Show that no asymptotically stable rest points are possible for Hamil- 


tonian system (6.6.21). 


(iv) Let (a, b) be a point of strict local minimum or maximum of V(x), x2). 


Show that (a, b) is a center for (6.6.21). 
(v) Show that the trajectories of are orthogonal to the trajectories of 
(6.6.21), at all points (x1, x2). 
8. In the Lotka-Volterra predator-prey system let p = Inx and q = Iny. 
Show that for the new unknowns p(t) and q(t) one obtains a Hamiltonian 
system, with V(p, q) = cp — de? + aq — be?. 


9. Consider the system (x(t) is a vector in R”) 
x’ =[A+B(t)]x, t> to, (6.6.22) 


where A is an n Xn matrix with constant entries and the n x n matrix B(t) sat- 
isfies i ||B(t)|| dt < co. Assume that the eigenvalues of A are either negative 
or have negative real parts (recall that such matrices are called stable). Show 
that lim,_,,, x(t) = 0, for any solution of (6.6.22). 


Hint. Treating the B(t)x(t) term as known, one can regard as a non- 
homogeneous system and write its solution as 


t 
x(t) = eA@-t0) x(t9) + i eACt-5) B(s)x(s) ds. 
to 


By (@.4.9), the norm ||e4‘|| < ae~°', for some constants a > 0 and b > 0, with 
t > 0. Then 


t 
Ix(OI) < Ke 4a f eM UBEI|Ix()I ds 
to 


where K = ae‘o||x(to)||. Letting u(t) = e?!||x(t)||, obtain 


t 
lui) <K+a f [BG)IIhaI as 
to 


Apply the Bellman-Gronwall lemma. 
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IV. 1. Consider the linear equation 
x’ = a(t)x + D(t), (6.6.23) 
with given p-periodic functions a(t) and b(t). 
(i) Let x(t) be some solution of (6.6.23). Show that x(t+ p) is also a solution 
of (6.6.23). 


Hint. x(t) satisfies (6.6.23) at all t, in particular at t + p. 


(ii) Let x(t) be a solution of (6.6.23), such that x(p) = x(0). Show that x(t) 
is a p-periodic function. 


Hint. x(t) and x(t + p) are two solutions of (6.6.23) that coincide at 
t=0. 


2. Consider a generalized logistic model 


x’ = x? (a(t) — D(t)x), 


with positive p-periodic functions a(t) and b(t). Show that there is a unique 
positive p-periodic solution, which attracts all other positive solutions, as t > 
wo. 


Hint. Show that the Poincaré map x9 — x(p, Xo) takes the interval (€, M) into 
itself, provided that ¢ > 0 is small and M is large. For the uniqueness part, 
show that y(t) = a satisfies 

x 


— x 
y= st eG 


The difference of any two positive p-periodic solutions of the last equation 
satisfies w’ = c(t)w, with a negative c(t). 


3. (Another example of Fredholm alternative.) Consider the equation 
x’ +a(t)x =1, (6.6.24) 
with a p-periodic function a(t). 


(i) Assume that f) a(t)dt = 0. Show that the problem has no p- 
periodic solution. 


Hint. Let z(t) > 0 be a p-periodic solution of 
z’—a(t)z=0. 


Combining this equation with (6.6.24), conclude that f’ z(t) dt = 0, 
which is a contradiction. 


(ii) Assume that f.’ a(t)dt # 0. Show that the problem has a p- 
periodic solution and moreover this solution satisfies Se x(t) dt #0. 


Hint. Solve (6.6.24), with initial condition x(0) = a, and select a so that 
x(p) = x(0) =a. 


6.6. Periodic Population Models 257 


4. Consider the logistic model 
x’ = a(t)x — b(t) x?, 


with p-periodic functions a(t) and b(t). Assume that Se a(t) dt = Oand b(t) > 
0 for all t. Show that this equation has no nontrivial p-periodic solutions. 


Hint. Any nontrivial solution satisfies either x(t) > 0 or x(t) < 0, for all t. 
Divide the equation by x(t), and integrate over (0, p). 


The Fourier Series and 
Boundary Value Problems 


The central theme of this chapter involves various types of Fourier series and the method 
of separation of variables, which is prominent in egineering and science. The three 

main equations of mathematical physics, the wave, the heat, and the Laplace equa- 

tions, are derived and studied in detail. The Fourier transform method is developed and 

applied to problems on infinite domains. Nonstandard applications include studying 

temperatures inside the Earth and the isoperimetric inequality. 


7.1 The Fourier Series for Functions of an Arbi- 
trary Period 

Recall that in Chapter 2|we studied the Fourier series for functions of period 27. Namely, 

if a function g(t) has period 27, it can be represented by the Fourier series 


g(t) = dy + >) (a, cosnt + b, sinnt), 


n=1 


with the coefficients given by 


1 7 
aj = sz facet 
7 


a= =| g(t) cos nt dt, 
—7 


va 
1 7 
b, = =| g(t) sinnt dt. 
1 
—T 
Observe that the knowledge of a 27-periodic function g(t) over the interval (—7, z] is 


sufficient to describe this function for all t € (—oo, oo). 
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Suppose now that f(x) has a period 2L, where L > 0 is any number. Consider an 
auxiliary function g(t) = f (<2). Then g(t) has period 27, and we can represent it by 
7 
the Fourier series 


(oe) 


t (=) = g(t) =agt+ > (a, cosnt + b, sinnt), 


n=1 


with the coefficients 


7 7 
1 1 L 
a= |] g®de= all t (=r) dt, 
=70 -—T 
7 7 
1 1 L 
a, = al g(t) cos nt dt = al t (=r) cos nt dt, 
—T -—T 
7 7 
1 ; 1 L ; 
by = =| g(t) sinnt dt = al t (=) sin nt dt. 
—T -—T 
Set here 
x=-t or t= =x 
~ 7? ie ia 
Then the Fourier series takes the form 
ce 
ni _ AT 
f(x) =a) + »y (a, cos [x +b, sin Tae (7.1.1) 


and making a change of variables t > x, by setting t = “x with dt = 7 dx, we express 
the coefficients as 


L 
aj = xz | foe 


L 
a, = al f(x) cos aK dx, 
se (7.1.2) 


1 . _ AT 
b, = L f(x)sin T* dx. 
=L 


The formula gives the desired Fourier series for functions of period 2L. Its coef- 
ficients are computed using the formulas (7.1.2). Observe that one needs the values of 
f() only on the interval (—L, L), when computing the coefficients. 

Suppose that a function g(x) is defined on some interval (—L,L). The function 
G(x) is called the periodic extension of g(x), provided that 


(i) G(x) = g(x), for -—L < x < L, 
(ii) G(x) is periodic with period 2L. 


Observe that G(x) is defined for all x, except possibly for x = nL with integer n. 


Example 7.1.1. Let f(x) be the function of period 6, which on the interval (—3, 3) is 
equal to x. 
Here L = 3, and f(x) = x on the interval (—3, 3). The Fourier series has the form 
ni 


f(x) =a) + »y (a, cos —-x + 5, sin =o) 
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S n7 
The functions x and x cos >* are odd, and so 


3 


1 
ay = 3 | xdx =0, 
-3 


3 


a, = al xX COS x dx =0. 
-3 


: - AT. Par 
The function x sin =; * is even, giving 


1 ° nt 
b, = 5 [xin ax 


3 
2 . na 

== x sin —x dx 
Je 3 


= =| 2 X COS lee sin atx] i 
~ 3 nz 3 n272 3 0 


Il 


6 
—— cosnm 
n 
6 
= —(-1 ntl. 
ame 
because cos nz = (—1)”. We conclude that 
— 6 na 
‘a —(—] Nt+1 gi, * . 
FX) py nae Wn sin x 


Restricting to the interval (—3, 3), we have 
nt 
= —(—1)"*1 gin — : for — . 
x > (-1) sin "x or-—3<x<3 


Outside of the interval (—3, 3) this Fourier series converges not to x, but to the periodic 
extension of x, which is the function f(x) that we started with. 


We see that it is sufficient to know f(x) on the interval (—L, L), in order to compute 
its Fourier coefficients. If f(x) is defined only on (—L, L), it can still be represented by 
the Fourier series (7.1.1). Outside of (—L, L), this Fourier series converges to the 2L- 
periodic extension of f(x). 


7.1.1 Even and Odd Functions. Our computations in the preceding example 
were aided by the nice properties of even and odd functions, which we review next. 
A function f(x) is called even if 


f(-x) = f() for all x. 


Examples include cos x, x*, x*, and in general x2”, for any even power 2n. The graph 
of an even function is symmetric with respect to the y-axis. It follows that 


il f(x)dx =2 [ ” fo dx, 


for any even function f(x) and any constant L. 


2 
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A function f(x) is called odd if 
f(x) = -f(x) for all x £0. 


(This definition allows f(x) to be discontinuous at x = 0; but if f(x) is continuous 
at x = 0, then it implies that f(0) = 0.) Examples include sin x, tan x, x, x3, and in 
general x2n+! for any odd power 2n + 1. (The even functions “eat” minus, while the 
odd ones “pass it through”.) The graph of an odd function is symmetric with respect to 
the origin. It follows that 


L 
[ f(x) dx = 0, 
-L 


for any odd function f(x) and any constant L. Products of even and odd functions are 
either even or odd: 


even - even = even, even - odd = odd, odd - odd = even. 


If f(x) is even, then b,, = 0 for all n (as integrals of odd functions), and the Fourier 
series ({7.1.1]) becomes 
nz 
—x, 


f(x) =a + y Ay COS | 


n=1 


Ww i th 
a, = x dx 
0 L f( ) ? 


L 
a, = al f(x) cos aK dx. 
0 


If f(x) is odd, then ay = 0 and a,, = 0 for all n, and the Fourier series ((7.1.1]) becomes 
= _ na 
fmM= > b, sin T* 
n=1 
with 


2 ‘ _ AT 
by = L f(x)sin T* dx. 
0 


2 a oe 


The periodic extension of |x| as a function of period 
2 
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Example 7.1.2. Let f(x) be a function of period 2, which on the interval (—1, 1) is 
equal to |x|. 

Here L = 1, and f(x) = |x| on the interval (—1,1). The function f(x) is even, so 
that 


ce 
f(x) =a) + » a, COS NZX. 


n=1 
Observing that |x| = x on the interval (0, 1), we compute the coefficients 


1 


1 
ay = f xdx=-, 
A 2 


1 


a, = 2 f x cosnzx dx 
0 


ae E sinnzx cos nn) l 
nr n272 
A =2 
n272 


0) 


Restricting to the interval (—1, 1), 


1. ey Ay 
Ix] = 5+ D, a cosnex, for-1<x<l. 


Outside of the interval (—1,1), this Fourier series converges to the periodic extension 
of |x|, or to the function f(x). 
Observing that a, = 0 for even n, one can also write the answer as 


1 
|x| = 5 cos(2k + 1)7x, for-l<x <1. 


= 4 
2 (2k + 1)272 
(All odd n can be obtained in the form n = 2k + 1, with k = 0,1, 2.,....) 


7.1.2 Further Examples and the Convergence Theorem. Even and odd 
functions are very special. A “general” function is neither even nor odd. 


Example 7.1.3. On the interval (—2, 2), represent the function 


1 for-2<x <0, 
x for0<x <2 


F(x) = | 
by its Fourier series. 


This function is neither even nor odd (and also it is not continuous, with a jump 
at x = 0). Here L = 2, and the Fourier series has the form 


foe} 
na _ AT 
f(x) = do + Dy (a, cos Sx + b, sin +x): 
n=1 


Compute 
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where we broke the interval of integration into two pieces, according to the definition 
of f(x). Similarly 


0 2 

1 1 2(-1+(-1)” 

a, =3{ cos Tx 5 | eine aye = 
-2 0 


2 2 2 2 n2772 A 
1°. na Lie nr (-—1 -—(-1)") 

b, = x sin —x+ = x sin —x dx = —————_—— 
2 J_> 2 2 Jo 2 nz 


On the interval (—2, 2) we have 


ce 
_ 2(-—1+ (-1)") na (-—1-—(-1)") , na 
f= 1+ (AS es et — 7 sin =*]- 
The quantity —1+(—1)” is equal to zero if n is even, and to —2 ifn is odd. The quantity 
—1-—(-1)" is equal to zero if n is odd, and to —2 ifn is even. All even n can be obtained 
in the form n = 2k, with k = 1,2,3,..., and all odd n can be obtained in the form 
n = 2k — 1, with k = 1, 2,3,.... We can then rewrite the Fourier series as 


fm=1- » (aes ChAT isinknx), for —2 <x <2. 
k=1 = 


Outside of the interval (—2, 2), this series converges to the extension of f(x), as a func- 
tion of period 4. 


Example 7.1.4. Find the Fourier series of f(x) = 2sinx + sin’ x on the interval 
(—7. 7 ). 
Here L = 7, and the Fourier series takes the form 


ce 
f@®=ao+ > (a, cosnx + by, sinnx). 
n=1 
Let us spell out several terms of this series: 
f(X) = ap + a, cosx + ay COS 2x + a3 coS3x +--+ +b, sinx + by, sin2x+---. 


Using the trigonometric formula sin’ x = - a - cos 2x, write 
1 1 : 
f= 5S cos 2x + 2sin x. 


ae : : ? 1 1 
This is the desired Fourier series! Here ag = si a, = <a b, = 2, and all other coeffi- 
cients are zero. In effect, this function is its own Fourier series. 


Example 7.1.5. Find the Fourier series of f(x) = 2sinx + sin’ x on the interval 
(—27, 27). 
This time L = 27, and the Fourier series has the form 
ce 
n _ on 
f(x) =ag + 2 (a, cos 5x + 5, sin 5%) . 


As before, we rewrite f(x) as 
LA 
f= 55 cos 2x + 2sin x. 


And again this is the desired Fourier series! This time ag = -, a4 = = b, = 2, and 


Nie 


all other coefficients are zero. 
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To discuss the convergence properties of Fourier series, we need the concept of 
piecewise smooth functions. These are functions that are continuous and differentiable, 
except for discontinuities at some isolated points. In case a discontinuity happens at 
some point x9, we assume that the limit from the left f(x )—) exists, as well as the limit 
from the right f(x9+). (So that at a point of discontinuity either f(xq) is not defined 


or f(xo—) # f(Xo+) or f(%o) F limy x, f(%)-) 


Theorem 7.1.1. Let f(x) be a piecewise smooth function of period 2L. Then its Fourier 
series 


[oe] 
n7t ni 
Ag + (a cos —x + b, sin x) 
0 yy n L n L 


converges to f(x) at any point x where f(x) is continuous. If f(x) has a discontinuity at 
x, the Fourier series converges to 


f(x-) + f+) 
5 


The proof can be found in the book of H. F. Weinberger [B@]. (At jump points, the 
Fourier series tries to be fair, and it converges to the average of the limits from the left 
and from the right.) 

Now let f(x) be defined on [—L,L]. Let us extend it as a function of period 2L. 
Unless it so happens that f(—L) = f(L), the extended function will have jumps at 
x = —Land x = L. Then this theorem implies the next one. 


Theorem 7.1.2. Let f(x) be a piecewise smooth function defined on [—L, L]. Let x be a 
point inside (—L, L). Then its Fourier series 


fo} 
nt nt 
ag + (a cos —x + b, sin =x) 
0 & n L n L 


converges to f(x) at any point x where f(x) is continuous. If f(x) has a discontinuity at 
x, the Fourier series converges to 


F(x) + f+) 
———. 


At both end points, x = —L and x = L, the Fourier series converges to 
fL+) + fZ) 
2 
(the average of the limits from the right and from the left, at —L and L, respectively). 


7.2 The Fourier Cosine and the Fourier Sine 
Series 


Suppose a function f(x) is defined on the interval (0, L). How do we represent f(x) by 
a Fourier series? We can compute the Fourier series for functions defined on (—L, L), 
but f(x) “lives” only on (0, L). 

One possibility is to extend f(x) as an arbitrary function on (—L, 0) (by drawing 
randomly any graph on (—L, 0)). This gives us a function defined on (—L, L), which we 
may represent by its Fourier series, and then use this series only on the interval (0, L), 
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where f(x) lives, so that there are infinitely many ways to represent f(x) by a Fourier 
series on the interval (0, L). However, two of these Fourier series stand out, the ones 
when the extension produces either an even or an odd function. 

Let f(x) be defined on the interval (0, L). We define its even extension to the interval 
(—L, L) as follows: 


_\f@) ford0<x<L, 
Fela) = ae for -—L <x <0. 


(Observe that f,(0) is left undefined.) The graph of f,(x) is obtained by reflecting the 
graph of f(x) with respect to the y-axis. The function f,(x) is even on (—L, L), and so 
its Fourier series has the form 


ce 
na 
fe(x) =ag + » Ay COS ——X, (7.2.1) 
n=1 


with the coefficients 


a i oe 
a= 7 | hoax = 7 | f(x) dx, 


L L 
2 na 2 na 
= al fe(x) cos 7% dx = a f(x) cos 7* dx, 


because f,(x) = f(x) on the interval of integration (0, L). We now restrict the series 
({7.2.1)) to the interval (0, L), obtaining 


= nq 

f(x) =a + se Ay COS TX, for0<x<L, (7.2.2) 
with 
1 
a =F [ f(x) dx, (7.2.3) 
0 
2 t nr 

ee al f(x) cos 7% dx. (7.2.4) 


The series ({7.2.2), with the coefficients computed using the formulas (7.2.3) and (7.2.4), 


is called the Fourier cosine series of f(x). 
Where is f,(x) now? It disappeared. We used it as an artifact of construction, like 
scaffolding. 


Example 7.2.1. Find the Fourier cosine series of f(x) = x + 2 on the interval (0, 3). 
The series has the form 


F(%) = dy + Y) an cos x for 0 < x <3. 


Compute 
3 


1 7 
ene 
2 [cr 2)00s"x ao stat) mut wey 


nage 


a 
ra) 


a 
rs] 
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Answer. 


we 6(-1+(- ") oo _7 1 (2k —1)z 
X+2= = a2 * La 5 12 2) Gea 1m cos 3 Don 


st 


n=1 


Assume again that f(x) is defined only on the interval (0, L). We now define its 
odd extension to the interval (—L, L) as follows: 
f@) for0<x<L, 
fox) = 
—f(-—x) for-L<x<0. 


The graph of f,(x) is obtained by reflecting the graph of f(x) with respect to the origin. 
Observe that f,(0) is not defined. (If f(0) is defined, but f(0) # 0, this extension is still 
discontinuous at x = 0.) The function f,(x) is odd on (—L, L), and so its Fourier series 
has only the sine terms: 


£@)= >, basin aK, (7.2.5) 
n=1 


with the coefficients 
L 


L 
2 _ A 2 nT 
= “al fo(x) sin Trax = al f(x)sin 7 xx 


because on the interval of integration (0, L), f,(x) = f(x). We restrict the series (7.2.5) 
to the interval (0, L), obtaining 


= _ na 
f@o= au by, sin Te for0<x <L, (7.2.6) 
with 
2 - nz 
by = al f(x)sin 7* dx. (7.2.7) 
0 


The series ), with the coefficients computed using the formula (7.2.7), is called 
the Fourier sine series of f(x). 


Example 7.2.2. Find the Fourier sine series of f(x) = x + 2 on the interval (0, 3). 


Compute 
3 

2 4—10(—1)" 

=- Gein ede 
3 i 3 na 

We conclude that 

— 4—10(—1)" 
ae ——s ) sin ah, for0<x <3. 


Clearly, this series does not converge to f(x) at the end points x = 0 and x = 3 of our 
interval (0,3). But inside (0, 3), we do have convergence. 

We now discuss the convergence issue. The Fourier sine and cosine series were 
developed by using the Fourier series on (—L, L). It follows from the convergence the- 
orem, Theorem that inside of (0, L), both of these series converge to f(x) at points 


of continuity and to ore 


if f(x) is discontinuous at x. At both end points x = 0 
and x = L, the Fourier sine series converges to 0 (as can be seen directly from the se- 
ries), while the Fourier cosine series converges to f(0+) and f(L—), respectively. (The 


extension of f,(x) as a function of period 2L has no jumps at x = 0 and x = L.) 
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7.3 Two-Point Boundary Value Problems 


We shall need to find nontrivial solutions y = y(x) of the problem 
y"+aAy=0, 0<x<L, 
y(0) = y(L) = 0, 

on an interval (0,L). Here A is a real number. Unlike initial value problems, where 
the values of the solution and its derivative are prescribed at some point, here we pre- 
scribe that the solution vanishes at x = 0 and at x = L, which are the end points (the 
boundary points) of the interval (0, L). The problem (7.3.1) is an example of a boundary 
value problem. Of course, y(x) = 0 is a solution of our problem ({7.3.1}), which is called 
the trivial solution. We wish to find nontrivial solutions. What are the values of the 
parameter A for which nontrivial solutions are possible? 

The form of the general solution depends on whether A is positive, negative, or 
zero, so that there are three cases to consider. 


(7.3.1) 


Case 1. A <0. We may write 2 = —w*, with some w > 0 (w = V—A), and our equation 
takes the form 
y" —w*y =0. 
Its general solution is y = cye~®* + c,e**. The boundary conditions 
y(0) =c, +c, =0, 
(iL) Se “4g, +e%%e,.=0 
give us two equations to determine c, and cy. From the first equation, c, = —c,, and 


then from the second equation, c; = 0, so that c; = c, = 0, and the only solution is 
y = 0, the trivial solution. 


Case 2. A = 0. The equation takes the form 


y" —_ 0. 
Its general solution is y = c, + c)x. The boundary conditions 
y(0) = c, =0, 


y(L) = cyL +c, =0 


give us c; = c, = 0, so that y = 0. We struck out again in the search for a nontrivial 
solution. 


Case 3. A > 0. We may write 2 = w”, with some w > 0(w = Va), and our equation 
takes the form 


y" +07y =0. 
Its general solution is y = c, cos wx + Cz sinwx. The first boundary condition, 
yO) = c = 0, 


tells us that c} = 0. We update the general solution: y = c) sinwx. The second bound- 
ary condition gives 

y(L) = cz SinwL = 0. 
One possibility for this product to be zero is c, = 0. That would lead again to the 
trivial solution. What saves us is that sin wL = 0, for some “lucky” w’s, namely when 
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272 
_ _ _ nz _ Qa n° 70 — ‘ 
oL =n, Or = Wy, = = ,and then A, = ow}, = Zz ,n=1,2,3,.... The corresponding 


. . n7 5 . . n7 
solutions are c, sin 7% or we can simply write them as sin 7» because a constant 
multiple of a solution is also a solution of ({7.3.1]). 


To recapitulate, nontrivial solutions of the boundary value problem ({7.3.1) occur 
2 772: 
at the infinite sequence of 2’s, A, = — called the eigenvalues, and the corresponding 


solutions y, = sin “x are called the eigenfunctions. 
Next, we search for nontrivial solutions of the problem 
y"+dAy=0, 0<x<L, 
y'(0) = y'Z) = 0, 
in which the boundary conditions are different. As before, we see that in case 2 < 0, 
there are no nontrivial solutions. The case A = 0 turns out to be different: any nonzero 


constant is a nontrivial solution, so that Ap = 0 is an eigenvalue and yy = 1 is the 


corresponding eigenfunction. In case A > 0, we get infinitely many eigenvalues /,, = 
2 
a with the corresponding eigenfunctions y,, = cos mx, n = 1,2, 3,.... 


7.3.1 Problems. 


I. 1. Is the integral i tan’? x dx positive or negative? 


Hint. Consider first i tan’ x dx. 
Answer. Positive. 


2. Show that any function can be written as a sum of an even function and an 
odd function. 


FO)+f(-%) i fO)-f(-X) 


Hint. f(x) = - : 


3. Let g(x) = x on the interval [0, 3). 
(i) Find the even extension of g(x). 


Answer. £2(x) = |x|, defined on (—3, 3). 
(ii) Find the odd extension of g(x). 
Answer. g,(x) = x, defined on (—3, 3). 


4. Let h(x) = —x? on the interval [0,5). Find its even and odd extensions, and 
state the interval on which they are defined. 


Answer. h,(x) = —|x|? and ho(x) = —x?, both defined on (—5, 5). 


5. Let f(x) = x? on the interval [0,1). Find its even and odd extensions, and 
state the interval on which they are defined. 
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Answer. f,(x) = x|x|, defined on (—1, 1). 
6. Differentiate the functions f(x) = x|x|P~1 and g(x) = |x|?, with p > 1. 


Hint. The function f(x) is odd, so that f’(x) is even. Begin by computing 
f' (x) for x > 0. 


Answer. f'(x) = p|x|P7}; g’(x) = px|x|P-?. 


7. Assume that f(x) has period 27. Show that the function Se f(dt is also 
27-periodic if and only if i, ” f(t)dt =0. 
8. Assume that f(x) has period T. Show that for any constant a 


T+a 


i f' (Def dx = 0. 


II. Find the Fourier series of a given function over the indicated interval. 


1. f(x) = sin x cos x + cos? 2x on (—7, 71). 
1 1 ite 
Answer. f(x) = sik 5 cos 4x +5 sin 2x. 
2. f(x) = sin x cos x + cos? 2x on (—2z7, 27). 
1 1 i. 
Answer. f(x) = ; + 5 cos 4x + 5 sin 2x. 
3. f(x) = sin xcos x + cos? 2x on (—7/2, 27/2). 
1 1 dies 
Answer. f(x) = ra 5 cos 4x + 5 sin 2x: 


4. f(x) = x+x? on (—7,7). 


1s 


Answer. f(x) = —+ yt 


4(-1)" a-pm 
cos nx + ———— sinnx }. 
n 


2 
3 n2 


5 (@) f= ' for0<x <7, Cee: 


—1 for-7z7<x <0, 


Answer. f=+ sinx + ~ sin3x + ~sin5x + —~sin7x +---). 
7 3 5 7 


(ii) Setx = 7 in the last series, to conclude that 
2 


cote Wiese 
4. 3.5 7 


6. f(x) = 1— |x| on (2, 2). 


oe) 4 
n=1 y2772 


Answer. f(x) => (1 —(—1)") cos x. 
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7. 


f(x) = x|x| on (-1, 1). 


co = —2(n?2?-2)(-1)"-4 


ae ae sin n7x. 


Answer. f(x) => 


1 for-1<x<0O, 


. Let f(x) = on (—1, 1). 


0 for0<x<1l, 
Sketch the graphs of f(x) and of its Fourier series. Then calculate the Fourier 
series of f(x) on (—1, 1). 


Answer. f(x) = - - ie ae sin(2k — 1)zx. 


for -—2<x <0, 


_ Let f(x) =4* on (-2, 2). 


—1 for0<x <2, 
Sketch the graphs of f(x) and of its Fourier series. Then calculate the Fourier 
series of f(x) on (—2, 2). 


Il. Find the Fourier cosine series of a given function over the indicated interval. 


1. 


f(x) = cos 3x — sin? 3x on (0, zz). 


Answer. f(x) = -* + cos 3x + ~ cos 6x. 


. f(x) = cos 3x — sin? 3x on (0, “). 


Answer. f(x) = -* + cos 3x + ~ COS 6x. 


. f(x) = x on (0,2). 


= _7)\4 
Answer. f(x) =1+ aa TAHA)" cos ox. 


n27¢2 


. f(x) = sin x on (0, 2). 


Hint. sin ax cos bx = ; sin(a — b)x + ; sin(a + b)x. 


Avsier FQ) <= “(1 —cos2) + ys 4((=)" cos 2—1) cos ox. 


n272—4 


. fxe= sin* x on (0, “). 


3 
Answer. f(x) = a = COS 2x + = COS 4x. 


IV. Find the Fourier sine series of a given function over the indicated interval. 


1. f(x) = 5sin x cos x on (0,7). 


Answer. f(x) = > sin 2x. 


272 


x 
f= 
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. f(x) = 10n (0, 3). 


Answer. f(x) = Dp, — (1- (-1)")sin =x. 


. f(x) = x on (0,2). 


Answer. fi) = Dinar gg(-D"™ sin Ex, 


. f(x) = sin x on (0, 2). 


Hint. sin ax sin bx = - cos(a — b)x — - cos(a + b)x. 


2nzsin2. 


n272—4 


nt 
oer, 


Answer. f(x) = yo 


. fx= sin? x on (0, z). 


nt 
Hint. e'3* = (e'*) . Use Euler’s equation on both sides and then compare the 
imaginary parts. 


3, 1. 
Answer. rl sin x — z sin 3x. 


for0<x <4, 
= 2 on (0, 7). 
ee for > <x <a, 


foe} 4 
n=1 gzy2 


Answer. f(x) => sin = sin nx. 


. f(x) = x—10n (0,3). 


eas n 
Answer. f(x) =—- aan 2+4(-1) ain my 
i n7 


. Find the eigenvalues and the eigenfunctions of 


y"+Ay=0, 0<x<L, y(O)=ywL)=0. 


m(n+1)2 m(n+2) 
Answer. A, = 2; 2 


Tas eee 


. Find the eigenvalues and the eigenfunctions of 


y’+dAy=0, 0<x<L, yO)=y(L)=0. 


2 1\2 1 
Answer. A, = eae woe 


p 7en 


. Find the eigenvalues and the eigenfunctions of 


y” +Ay=0, y(x) isa 27 periodic function. 
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Answer. A, = 0 with yy = 1, and, =n?’ with y, = a, cosnx + b, sinnx. 


4. Find all nontrivial solutions of an integro-differential equation 


1 
v+(f vedas) =o, O0<x<1, y0)=yQ)=0. 
0 


Hint. ty y*(x) dx is a constant. 


Answer. y = +/2nn sin n7zx, with integer n > 1. 


Nn 
* 


Show that the fourth-order problem (with a > 0) 


a 


y”"-aty=0, 0<x<1, y0)=y(0)=y1)=y'(1) =0 


has nontrivial solutions (eigenfunctions) if and only if a satisfies 


cosa = 


cosh a’ 
Show graphically that there are infinitely many such a’s, and calculate the 
corresponding eigenfunctions. 


Hint. The general solution is y(x) = c, cosax + c)sinax + c3coshax + 
c4 sinh ax. From the boundary conditions obtain two equation for c3 and cq. 


7.4 The Heat Equation and the Method of Sepa- 
ration of Variables 


u 
A 


u(x, t) 


—_——SE_—_—_— = UX 


x x + Ax L 


Heat flows in at x + Ax and escapes at x. 


Suppose we have a rod of length L, so thin that we may assume it to be one dimen- 
sional, extending along the x-axis, for 0 < x < L. Assume that the surface of the rod 
is insulated, so that heat can travel only to the left or to the right along the rod. We 
wish to determine the temperature u = u(x, ft) at any point x of the rod and at any time 
t > 0. Consider an element (x, x + Ax) of the rod, of length Ax. The amount of heat 
(in calories) that this element holds we approximate by 


cu(x, t)Ax. 


274 Chapter 7 The Fourier Series and Boundary Value Problems 


Indeed, the amount of heat ought to be proportional to the temperature u = u(x, ft) 
and to the length Ax. A physical constant c > 0 reflects the rod’s capacity to store heat 
(c also makes the physical units right, so that the product is in calories). The rate of 
change of the amount of heat is 
cu, (x, t)Ax, 
where u,(x,t) denotes the partial derivative in t. The change in the amount of heat 
occurs because of the heat flow through the end points of the interval (x, x + Ax). The 
function u(x, t) is likely to be monotone over the small interval (x, x + Ax), so let us 
assume that u(x, t) in increasing in x over (x, x + Ax) (think of t as fixed). At the right 
end point x + Ax, heat flows into our element, because to the right of this point the 
temperatures are higher. The heat flow per unit of time (called the heat flux) is assumed 
to be 
C1Ux(x + Ax, ft), 
or proportional to the rate of temperature increase (c,; > 0 is another physical constant). 
Similarly, at the left end point x 
Cy U(x, t) 
calories of heat are lost per unit of time. The equation of heat balance is then 
cu, (x, t)Ax = cyu,(x + Ax, t) — cyu,(x, t). 
Divide by cAx, and call “ =k, Then 
c 


U,(x + Ax, t) — u,(x, t) 
Ax ‘ 
And finally, we let Ax — 0, obtaining the heat equation 


u,(x,t) =k 


Uy = kux x. 


It gives an example of a partial differential equation, or a PDE, for short. (So far we 
studied ordinary differential equations, or ODE’s, with unknown functions depending 
on only one variable.) 

If u(x, t) and uy(x, t) are two solutions of the heat equation, then so is cu4(x, t)+ 
C2U2(x,t), for any constants c,; and cz, as can be seen by a direct substitution. The 
situation is similar in case of three or more solutions. This superposition property of 
solutions could be taken as a definition of linear PDE. More formally, an equation is 
called linear if it depends linearly on the unknown function and its derivatives. We 
shall consider only linear PDE’s in this chapter. 

Suppose now that initially, or at the time t = 0, the temperatures inside the rod 
could be obtained from a given function f(x), while the temperatures at the end points, 
x = Oand x = L, are kept at 0 degrees Celsius at all time t (think that the end points 
are kept on ice). To determine the temperature u(x, t) at all points x € (0,L) and all 
time t > 0, we need to solve 


Uz = kuyy for0<x<Landt>0, 
u(x, 0) = f(x) for0<x<L, (7.4.1) 
u(0,t) = u(L,t)=0 fort> 0. 


Here the second line represents the initial condition, and the third line gives the bound- 
ary conditions. 
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Separation of Variables. We search for a solution of (7.4.1) in the form u(x,t) = 
F(x)G(t), with the functions F(x) and G(t) to be determined. From the equation ({7.4.1]) 


F(x)G'(t) = KF" (x)G(t). 


Divide by kF(x)G(t): 
Gi(t) _ F"(x) 
kG(t) F(x)’ 
On the left we have a function of t only, while on the right we have a function of x only. 
In order for them to be the same, they must be both equal to the same constant, which 
we denote by —A: 
Git) _ F(x) _ 
kG(t) F(x) 
This gives us two differential equations, for F(x) and G(t), 
Gi(t) _ 
kG(t) 


—A (7.4.2) 


and 
F"(x) + AF(x) = 0. 
From the boundary condition at x = 0, 
u(0, t) = F(0)G(t) = 0. 


This implies that F(0) = 0 (setting G(t) = 0 would give u = 0, which does not satisfy 
the initial condition in (7.4.1). Similarly, we have F(L) = 0, using the other boundary 
condition, so that F(x) satisfies 


F" (x) + AF(x) = 0, F(0) = F(L) = 0. (7.4.3) 
We studied this problem in the preceding section. Nontrivial solutions occur only at 


nn? : : 
A =A, = —. Corresponding solutions are 
n 12 


F(x) = sin aK (and their multiples). 
2 a2 
WithA =A, = = the equation ({7.4.2)) becomes 
G'(t) nz? 
— = : 74.4 
G(t) i ( ) 


Solving these equations for all n, 
n2 72 
G,(t) =b,e * @ *, 
where the b,,’s are arbitrary constants. We have constructed infinitely many functions 
_ pm nt 
Uy,(x, t) = G,(t)F, (x) = bye kT‘ sin T* 


which satisfy the PDE in (7.4.1) and the boundary conditions. By linearity, their sum 


= ke one 
u(x, t) = > Upy(x, t) = be bre? ~~ sin T* (7.4.5) 
n=1 n=1 
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also satisfies the PDE in (7.4.1) and the boundary conditions. We now turn to the initial 
condition: 


ce 
u(x,0) = Dy by sin x = f(x). (7.4.6) 
n=1 L 
We need to represent f(x) by its Fourier sine series, which requires 
L 
by = 2 f(x)sin nt x dx. (7.4.7) 
Ey, L 
Conclusion: the series 
a ee 7 a 
,t)= 12 sin —x, 7A. 
u(x, t) »y bye sin [x (7.4.8) 


with the b,,’s calculated using ({/.4.7), gives the solution of our problem ((/.4.1)). Observe 
that going from the Fourier sine series of f(x) to the solution of our problem (7.4.1) in- 


n27 
volves just putting in the additional factors ea Tn practice, one should memorize 
the formula ({7.4.8). 


Example 7.4.1. Find the temperature u(x, t) satisfying 


Uy = SUxx for0 <x < 2zandt > 0, 
u(x, 0) = 2sinx — 3sin x cos x for 0 < x < 27, 
u(0, t) = u(2z, t) = 0 for t > 0. 


Here k = 5and L = 27. The Fourier sine series on (0, 277) has the form ae b, sin aX. 
Writing the initial temperatures as 


; : ; 3. 3 
2sinx — 3sinxcosx = 2sinx — 3 Sin 2x, 


we see that this function is its own Fourier sine series, with b, = 2, b, = — =, and all 
other coefficients equal to zero. According to (7.4.8), the solution is 
52 p72: 4272 


poe Se oe o 
u(x, f) = 2e “ez sinx — xe Qn)?" sin 2x = 2e> 


2 


F 3 . 
‘sinx — af Of sin 2x. 


By the time t = 1, the first term of the solution totally dominates the second one, so 
that u(x, t) + 2e-* sin x fort > 1. 


Example 7.4.2. Solve 


Uy = 2Uyx for0<x<3andt>0, 
u(x,0)=x-1 for0 <x <3, 
u(0, t) = u(3,t) = 0 for t > 0. 


Here k = 2 and L = 3. We begin by calculating the Fourier sine series 


[oe] 
_ nn 
x-l= > b,, sin —x, 
3 
n=1 


with 
2+4(-1)" 


3 
bn = | @—Dsin xay = - a 
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Then, we put in the appropriate exponential factors, according to ({7.4.8). The solution 
is 


(oe) 2 a2 
2+4(-1)" 2") . na 
u(x, t) = — > ———e ~ 9 sin —x. 
= nr 3 


What is the value of this solution? The initial temperatures, u(x,0) = x — 1, are 
negative for 0 < x < 1 and positive for 1 < x < 3. Again, very quickly (by the time 
t = 1), the first term (n = 1) dominates all others, and then 

2 _ 20? . 
’ tHre- 9 BA 
u(x, t) ae sin 3x 
so that the temperatures become positive at all points, because the first harmonic 
sin ex > 0, on the interval (0,3). For large t, the temperatures tend exponentially 
to zero, while retaining the shape of the first harmonic. 

Assume now that the rod is insulated at the end points x = 0 and x = L. Recall 
that the flux at x = 0 (the amount of heat flowing per unit of time) is proportional to 
u,(0, t). Since there is no heat flow at x = 0 for all t, we have u,,(0, t) = 0, and similarly 
u,(L, t) = 0. If the initial temperatures are prescribed by f(x), one needs to solve 

uz = kuyx for0<x<Landt>0, 
u(x, 0) = f(x) for0 <x <L, (7.4.9) 
u,(0,t) =u,(L,t)=0 fort> 0. 
It is natural to expect that in the long run the temperatures inside the rod will average 
out and be equal to the average of the initial temperatures, : - f(x) dx. 

Again, we search for a solution in the form u(x, t) = F(x)G(t). Separation of vari- 

ables shows that G(t) still satisfies (7.4.4), while F(x) needs to solve 
F" (x) + AF(x) = 0, F'(0) = F'(L) = 0. 


Recall that nontrivial solutions of this problem occur only at 2 = Ay = O and atdA = 


n272 : 3 
An = oa The corresponding solutions are 
Fo(x)=1, F,(x) =cos ae (and their multiples). 
Solving for n = Oand for all n = 1,2, 3...., gives 


Ke 
Gop=d, G,(t)=a,e 2, 
where dy and the a,,’s are arbitrary constants. We constructed infinitely many func- 
tions 
n2 72 


Ug(2,1) = GQ) = do, Un(Xst) = Gy(OF() = ane ‘cos x, 


satisfying the PDE in and the boundary conditions. By linearity, their sum 


oo co n2 72 
= nr 
u(x, t) = u(x, t) + > U,(x,t) = dg + > ane KT cos x (7.4.10) 
n=1 n=1 L 


also satisfies the PDE in and the boundary conditions. To satisfy the initial con- 
dition 


= nq 
u(x, 0) = ay + > Ay COS F—X = f@) 


n=1 
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one needs to represent f(x) by its Fourier cosine series, for which we calculate 


L L 
1 2 
a= f(x)dx, a,==- f(x) cos ie dx. (7.4.11) 
L 0 L 0 L 
Conclusion: the series 
0 pen ni 
u(x, t) = ag + » a,e 1 cos 77% (7.4.12) 


n=1 


with the a,’s computed using (7.4-1]]), gives the solution of our problem (7.4.9). Ob- 


serve that going from the Fourier cosine series of f(x) to the solution of the problem 
n2 72 


involves just putting in the additional factors er Ast: 00, u(x,t) > ao, 


which is equal to the average of the initial temperatures. The first term of the series 
2 


1 
dominates all others, and so u(x, t) © dg + aye “iz! cos “x, for t not too small, say for 
t>1. 


Example 7.4.3. Solve 


Uz = 3Uxx for0 <x <az/2andt > 0, 
u(x, 0) = 2cos? x — 3 cos? 2x for 0 <x < 7/2, 
u,(0, t) = u,(7/2, t) = 0 for t > 0. 


Here k = 3 and L = 7/2. The Fourier cosine series has the form ay + ae a, COS 2nNx. 
Writing 


1 3 
2 cos? x — 3 cos? 2x = - + cos 2x — 5 cos4ex, 
we see that this function is its own Fourier cosine series, with ag = “>a = 1, 
3 : eer : 
Oy = =F and all other coefficients equal to zero. Putting in the exponential factors, 


according to ({/.4.12)), we arrive at the solution: 


1 
u(x, t) = =o% e~ 2! cos 2x — sete cos 4x. 


Example 7.4.4. Solve 


Uz = 3Uyx, — au for0<x<zandt>0, 
u(x,0) = 2cos x + x? for0<x <7, 
u,(0,t) = u,(z, t) = 0 fort > 0, 


where a is a positive constant. The extra term —au is an example of a lower-order term. 
Its physical significance is that the rod is no longer insulated and heat freely radiates 
through its side, with the ambient temperature outside of the rod being zero. Indeed, 
the heat balance relation leading to this equation is 


u,Ax = 3 [u,(x + Ax, t) —u,(x, t)] — au(x, t)Ax. 


If u(x, t) > 0, heat radiates out, and if u(x,t) < 0, heat enters through the side of the 
rod. 
Let u(x, t) be the new unknown function, defined by 


u(x, t) = ev (x, ft). 
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Calculate u, = —ae~“v + ev, and u,, = e~“v,,. Then v(x, t) solves the problem 
Vz = 3Vxx for0 <x <zandt> 0, 
v(x,0) =2cosx+x* for0<x<z, (7.4.13) 


v,(0,t) = v,(z,t)=0 fort >0, 


which we know how to handle. Because 2 cos x is its own Fourier cosine series on the 
interval (0, 77), we expand x? in the Fourier cosine series (and then add 2cos x). We 
obtain 


co 
x* =ag+ » Ay COS NX, 
n=1 
where 
ie 
1 ; x 
ag=rz x“dx = 3° 
se 
8 
3 3 4(-1)" 
a, = — x“ cosnx dx = EL 
1 n 
0 
Then 


2. n 2 00 n 
cv T 4(-1) 
2cos x + x? = 2cosx + = + cosnx = —- — 2cosx + > 7 cos nx. 


n=1 n=2 


Using (7.4.12), the solution of (7.4.13) is 


a 
v(x, t) = < — 2e—* cos x + oo 
n=2 


palate = e73”t cos nx. 


me = co 4(-1)"__(3,2 
Answer. u(x,t) = =e at — 2e“Gt Ot cosx + Yr, aon" Gn*+a)t cos nx. 
= n 


7.5 Laplace’s Equation 


We now study heat conduction in a thin two-dimensional rectangular plate: 0 < x < L, 
0 <y <M. Assume that both sides of the plate are insulated, so that heat travels only 
in the xy-plane. Let u(x, y, t) denote the temperature at a point (x, y) and time t > 0. 
It is natural to expect that the heat equation in two dimensions takes the form 


Uz = k(uxx + Uyy). (7.5.1) 


Indeed, one can derive similarly to the way we have derived the one-dimensional 
heat equation; see e.g., the book of L. Evans [9]. 

The boundary of our plate consists of four line segments. Let us assume that the 
side lying on the x-axis is kept at 1 degree Celsius, so that u(x,0) = 1forO < x < 
L, while the other three sides are kept at 0 degrees Celsius (they are kept on ice), so 
that u(x,M) = 0 forO < x < Land u(0,y) = u(L,y) = OforO0 < y < M. The 
heat will flow from the warmer side toward the three sides on ice. While the heat will 
continue its flow indefinitely, eventually the temperatures will stabilize (we can expect 
temperatures to be close to 1 near the warm side and close to 0 near the icy sides). 
Stable temperatures do not change with time, so that u = u(x,y). Then u, = 0, and 
the equation becomes Laplace’s equation: 


Uxx + Uyy = 0, (7.5.2) 
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one of the three main equations of mathematical physics (along with the heat and the 
wave equations). Mathematicians use the notation Au = u,, + Uyy, while engineers 
seem to prefer V7u = ux, + Uyy. The latter notation has to do with the fact that com- 
puting the divergence of the gradient of u(x, y) gives V - Vu = uxx + Uyy. Solutions of 
Laplace’s equation are called harmonic functions. 

To find the steady-state temperatures u = u(x, y) for our example, we need to solve 
the problem 


Uxx + Uyy = 0 for0<x<Land0<y<M, 
u(x, 0) =1 for0<x<L, 
u(x,M) =0 for0<x<L, 
u(0, y) = u(L, y) = 0 for0<y<M. 


We apply the separation of variables technique, looking for a solution in the form 


u(x, y) = F(x)G(y), 
with the functions F(x) and G(y) to be determined. Substitution into the Laplace equa- 
tion gives 
F"(x)G(y) = —F(x)G"(y). 
Divide both sides by F(x)G(y): 


F'(x) __ _G"Y) 

F(x) Gy)” 
The function on the left depends on x only, while the one on the right depends only 
on y. In order for them to be the same, they must be both equal to the same constant, 
which we denote by —A: 


F'(x)_ _ GY) __ 


F(x) GY) 
Using the boundary conditions, we obtain 
F"+AF=0, F(0)=F(L)=0, (7.5.3) 
G" -A~AG =0, G(M)=0. (7.5.4) 


2 a2 
Nontrivial solutions of (7.5.3) occur ata =A, = a and they are F,,(x) = B, sin ax, 
2 ad 
with arbitrary constants B,. We solve the problem with 2 = a obtaining 
G,(y) = sinh = — M). (Recall that the general solution of the equation in ({7.5.4) 


may be taken in the form G = c, sinh a (y + C).) We conclude that the functions 
1 5 2 


Un(%,Y) = Fy(X)Ga(y) = By sin “x sinh *(y — M) 


satisfy Laplace’s equation and the three zero boundary conditions. The same is true for 
their sum 


foe) 


u(x, y) = » F,(x)G,(y) = > B, sinh “0 — M)sin ar. 
n=1 n=1 


It remains to satisfy the boundary condition at the warm side: 


ce 
u(x, 0) = » B, sinh “= (-M) sin aK =); 


n=1 
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We need to choose the B,,’s so that the B,, sinh = (-M ) are the Fourier sine series co- 
efficients of f(x) = 1, ie., 


L 
4 Nn _ 2 _ nn _ 20-(-1)") 
B, sinh 7 6 ™) = al sin sas dx = =e 


which gives 


21") 
By = ~~~ 
nz sinh 
Answer. 
- 201-(-1)%)) .. nx _ nn 
u(x,y) =— >» ee sinh To — M) sin T* 


n=1 nz sinh 


Recall that the general solution of (w is a constant, y = y(x)) 
y" _ wy —0 
can be written in three ways: y = c,e~®* + c,e**, y = c, cosh@x + cz sinhwx, and 


y =c, Sinhw(x +c). We used the third form when solving for G(y), while the second 
one is convenient if the initial conditions are prescribed at x = 0. 


Example 7.5.1. Find the steady-state temperatures 


Uxx + Uyy = 0 for0<x<land0<y< 2, 
u(x,0) =0 for0<x <1, 
u(x, 2) =0 for0<x <1, 
u(0, y) =0 for0<y <2, 
udl,y)=y for0<y <2. 


(The warm side is now x = 1.) Look for a solution in the form u(x, y) = F(x)G(y). 
After separating the variables, it is convenient to use A (instead of —A) to denote the 
common value of two functions: 
E"(x)__ Gy) _ 
F(x) G(y) 
Using the boundary conditions, obtain 
G" +AG=0, G(0O)=G(2) =0, 
F”-AF=0, F(0)=0. 


Qa 
The first problem has nontrivial solutions at A = A, = = , and they are G,(y) 
Qa 
B, sin S y. We then solve the second equation with 2 = ae obtaining F,(x) = 
sinh x. It follows that the functions 
_, nt, na 
Un(X, y) = F,(x)G,(y) = B, sinh ZX sin ay 


satisfy the Laplace equation and the three zero boundary conditions. The same is true 
for their sum 


= = : n7v . AT 
u(x, y) = » F,(x)G,(y) = >> B, sinh a sin 3 
n=1 


n=1 
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It remains to satisfy the boundary condition at the fourth side: 
= nq . na 
u(1,y) = » B,, sinh > sin 7 =y. 
n=1 
We need to choose the B,,’s so that the B,, sinh = are the Fourier sine series coefficients 
of y on the interval (0, 2): 


2 
An _ nn 4(-1)"*! 
B, sinh oe [ ysin a ydy = i ae a 
which gives 
4(-1)"*1 
By = 4 na 
nz sinh — 
2 
co 4(-1)"1 


— y nz 
n=1 nzsinh > 


Answer. u(x,y) => sinh “x sin ay. 

Our computations in the above examples were aided by the fact that three out of 
the four boundary conditions were zero (homogeneous). A general boundary value 
problem has the form 


Uxx + Uyy = 0 forO<x<Land0<y<M, 
u(x,0) = fi(x) for0<x<L, 
u(x,M) = f(x) for0<x<L, (7.5.5) 


u(0,y)=g,(y) forO<y<M, 
u(L, y) = go(y) forO<y<M, 


with given functions f,(x), (x), g:(7), and g,(y). Because this problem is linear, we 
can break it into four subproblems, each time keeping one of the boundary conditions 
and setting the other three to zero. Namely, we look for solution in the form 


U(x, y) = Uy (%, y) + Up (X, y) + Us (x,y) + Ug Y), 


where uw, is found by solving 


Uxx + Uyy = 0 forO<x<Land0<y<M, 
u(x, 0) = fi(x) for0<x<L, 
u(x, M) = 0 for0<x<L, 
u(0, y) =0 for0<y<M, 
u(L, y) =0 for0<y<M, 


uz is computed from 


Uxx + Uyy = 0 for0<x<Land0<y<M, 
u(x, 0) = 0 for0<x<L, 
u(x, M) = fo(x) for0<x<L, 
u(0, y) =0 for0<y<M, 


u(L, y) =0 for0<y<M, 
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U3 is computed from 


Uyx +Uyy = 0 for0<x<Land0<y<M, 
u(x,0) = 0 for0<x<L, 
u(x,M) = 0 for0<x<L, 
u(0, y) = 210) for0<y <M, 
u(L, y) =0 for0<y<M, 


and uy, is obtained by solving 


Uxx +Uyy = 0 forO<x<Land0<y<M, 
u(x,0) = 0 for0<x<L, 
u(x, M) = 0 for0<x<L, 
u(0, y) =0 for0<y<M, 
u(L, y) = g2.(y) forO<y<M. 


We solve each of these four problems using separation of variables, as in the examples 
considered previously. 


7.6 The Wave Equation 


We consider vibrations of a guitar string (or a similar elastic string). We assume that the 
motion of the string is transverse, so that it goes only up and down (and not sideways). 
Let u(x, t) denote the displacement of the string at a point x and time f, and our goal is 
to calculate u(x, t). The motion of an element of the string (x, x + Ax) is governed by 
Newton’s second law of motion 

ma = f. (7.6.1) 
The acceleration a = u;;(x,t). If o denotes the density of the string, then the mass 
of the element is m = pAx. (The string is assumed to be uniform, so that p > 0 is 
a constant.) We also assume that the internal tension is the only force acting on this 
element and that the magnitude of the tension T is constant throughout the string. Our 
final assumption is that the slope of the string u,,(x, t) is small, for all x and t. Observe 
that u(x, t) = tan 9, the slope of the tangent line to the function u = u(x), with t fixed. 
The vertical (acting) component of the force at the right end point of our element is 


Tsin@ = Ttan@ = Tu,(x + Ax, t), 


because for small angles 6, sin @ = tan @ ~ @. At the left end point, the vertical compo- 
nent of the force is Tu,,(x, t), and the equation ({7.6.1]) becomes 


pAxuy(x, t) = Tu,(x + Ax, t) — Tu,(x, t). 
Divide both sides by pAx, and denote T/p = c?: 


2 U(x + Ax, t) — u,(x, t) 


yt = 
Uy,(xX,t) = Cc Ax 


Letting Ax — 0, we obtain the wave equation 


Upp (x, t) = C7 U(x, t). 
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{ 
x x + Ax 
Forces acting on an element of a string. 
We consider now the vibrations of a string of length L, which is fixed at the end 


points x = 0 and x = L, with given initial displacement f(x) and given initial velocity 
g(x): 


dy = Cup, for0 <x <Landt>0, 
u(0, t) = u(L, t) = 0 for t > 0, 
u(x, 0) = f(x) for0<x<L, 
u,(x, 0) = g(x) for0<x<L. 


Perform separation of variables, by setting u(x, t) = F(x)G(t) and obtaining 
F(x)G" (t) = c?F"(x)G(t), 


G"(t) _ F" (x) 
c2G(t) F(x) 


Using the boundary conditions gives 


F" +.AF =0, F(0) = F(L) =0 
G” +Ac*G = 0. 


2 a2 
Nontrivial solutions of the first problem occur at 2 = A, = oe and they are F,(x) = 


sin ax. The second equation then takes the form 


Ging e 


a2 
5-cG =0. 
Its general solution is 


n7c n7c 
G,,(t) = by, cos Et + B, sin Th 


where b,, and B, are arbitrary constants. The function 
foe) 
na 


u(x, t) = > F,(x)G,(t) = a (bn cos et + B, sin at) sin 7T* 
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satisfies the wave equation and the boundary conditions. It remains to satisfy the initial 
conditions. Compute 


u(x, 0) = y by sin 2 x= f@), 


which requires that 


L 
2 [ nr 
== f(x) sin —x dx, (7.6.2) 
LJ L 
and 
u,(x,0) = > Bn ms sin are = g(x), 
n=1 
which implies that 
2 . nr 
B, = — in —xdx. 7.6. 
(2 j g(x) sin ——x x (7.6.3) 
Answer. 
— nme _ mmc) . nr 
u(x,t) = au (b, cos Tz! +B, sin st) sin [x (7.6.4) 


with the b,’s computed by (7.6.2), and the B,,’s by (7.6.3). 
The last formula shows that the motion of the string is periodic in time, similarly 


to the harmonic motion of a spring (the period is a, This is understandable, because 
70C 
we did not account for the dissipation of energy in our model of vibrating string. 


Example 7.6.1. Find the displacements u = u(x, t): 


Upp = IUyx for0 <x <zandt> 0, 
u(0, t) = u(z, t) = 0 for t > 0, 
u(x, 0) = 2sinx for0<x <7, 
u,(x, 0) = 0 for0<x <7. 


Here c = 3 and L = 7. Because g(x) = 0, all B, = 0, while the b,,’s are the Fourier sine 
series coefficients of 2 sin x on the interval (0, 7), so that b; = 2 and all other b, = 
Using gives the answer: u(x,t) = 2cos 3t sin x. 

To interpret this answer, we use a trigonometric identity to write 


u(x, t) = sin(x — 3t) + sin(x + 3). 


The graph of y = sin(x — 3t) in the xy-plane is obtained by translating the graph of 
y = sin x by 3t units to the right. Drawing these graphs on the same screen, for different 
times t, we see a wave traveling to the right with speed 3. Similarly, the graph of sin(x+3t) 
is a wave traveling to the left with speed 3. Our solution is the sum, or the superposition, 
of these two waves. For the general wave equation, the wave speed is given by c. 
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7.6.1 Nonhomogeneous Problems. Let us solve the following problem 


Uy —4Uxx =x for0<x<3andt>0, 
u(0,t)=1 fort >0, 
u(3,t)=2 fort>O0, 
u(x,0)=0 for0<x <3, 
u,(x,0)=1 for0<x <3. 
This problem does not fit the pattern studied so far. Indeed, the x term on the right 
makes the equation nonhomogeneous, and the boundary conditions are nonhomoge- 
neous (nonzero) too. We look for solution in the form 
u(x, t) = U(x) + v(x, f). 
We want the function U(x) to take care of all of our problems (to remove the nonho- 
mogeneous terms) and satisfy 
—4U" =x, 
U(0)=1, U(3)=2. 
Integrating twice gives 
i 7 
U(x) = 54% + aaxt 1. 
Then the function v(x, t) = u(x, t) — U(x) satisfies 


Uzt — 40x, = 0 for0<x<3andt>0, 
v(0, t) = 0 fort > 0, 
v(3, t) = 0 for t > 0, 
1 1 
v(x, 0) = —U(x) = sax - eH 1 for 0 < x < 3, 
v,(x,0) = 1 for0<x <3. 


This is a homogeneous problem of the type considered in the preceding section! Here 
c = 2 and L = 3. Separation of variables (or the formula (7.6.4) gives 


ce 
2n7 2n7 nw 
u(x, t) = b, cos ——t + B, sin <1) sin —x, 
a) X( i‘ 3 fs 3 3 
with 
3 
2 1 17 nq 2 274+ 8n?x? 
geet (Eee a) da pe ga 
5 aA og te eee ae es 
3 
— 3(—1)" 
= sin —x dx =< 
nt Jo n27 
Answer. 
1 17 
u(x,t) = me + 5qxtl 
co 
2 27+ 8n?2? Qnx, 3—3(-1)" . 2nxz |, na 
+d \(-a+ Bas (-1)") os 3 t+ ma i t}| sin 3 
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In the nonhomogeneous wave equation 
Upp — C’Uyx = F(x, 0), (7.6.5) 


the term F(x, t) represents the acceleration of an external force applied to the string. 
Indeed, the ma = f equation for an element of a string, in the presence of an external 
force, takes the form 

pAxu;, = T [u,(x + Ax, t) — u,(x, t)] + PAXF(x, t). 


Dividing by pAx and letting Ax — 0 (as before), we obtain (7.6.5). It follows that the 
pAxF(x, t) term represents an extra force and F(x, t) is its acceleration. 
Nonhomogeneous problems for the heat equation are solved similarly. 


Example 7.6.2. Let us solve the problem 


Uz — 2Uxx = 1 for0<x<landt>0, 
u(x, 0) = x for0 <x <1, 
u(0, t) = 0 for t > 0, 
u(1, t) = 3 for t > 0. 


Again, look for a solution in the form 
u(x, t) = U(x) + v(x, ft), 
with U(x) satisfying 
—2U" =1, 
U(0)=0, U(@)=3. 


Integrating, we calculate 


U(x) = 70 + 7H. 
The function v(x, t) = u(x, t) — U(x) satisfies 
V; — 20x, = 0 for0O<x<landt>0, 
v(x,0) = x — U(x) = 5x? — 2x for0<x <1, 
v(0, t) = v(1, t) = 0 fort > 0. 


To solve the last problem, we begin by expanding the initial temperature u(x, 0) in its 


Fourier sine series 
[oe] 


1, 9 ; 
4% - > s b, sinn7x, 


n=1 


1 272 n 
—1+(1+4+4n‘7*)(-1 
bn =2 f (32? - 7x) sinnaxdx = i+ (1+ 4ntx?)Cp" 
0 


4 n3703 
Then, using (7.4.8), 


with 


o, -1+ (1+ 4n?x7) (-1)" 
wet) = >) ( —— JED e727 sin nx, 
n=1 
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Answer. 


u(x, t) = -je eu = +2. 


7.6.2 Problems. 


I. Solve the following problems, and explain their physical significance. 


1. 
Uy = 2Uyx 


u(x, 0) = sin x — 3 sin x cos x 


oo, -14 (1+ 4n?n7) (-1)” 


enn t 


n373 


for0<x<zandt>0O, 


for0<x <7, 


u(0, t) = u(z, t) =0 for t > 0. 
Answer. u(x, t) = e~*! sinx — ~e-8! sin 2x. 
2. 
Uy = 2Uyx for0 <x < 2m andt > 0, 
u(x, 0) = sinx — 3sinxcos x for 0 < x < 27, 
u(0, t) = u(2z, t) = 0 fort > 0. 
Answer. u(x, t) = e~*! sinx — ~e-8! sin 2x. 
3. 
Uy = SUyy forO<x<2andt>0, 
u(x,0) = x for 0 < x < 2, 
u(0, t) = u(2,t) =0 for t > 0. 
ae 4-pnt t . na 
Answer. u(x,t) = >) 4 ——e sin x 
4. 
Uz = 3Uyx for0 <x <zandt> 0, 
x for0<x< S 
u(x, 0) = . 2 for0<x<zZ, 
a—x for 3 <x<7, 
u(0, t) = u(z, t) = 0 fort > 0. 
_ae 4  _3y2¢ . nT. 
Answer. u(x,t) = yet =o sin — sinnx. 
2: 
Uy = Uxx for0O<x<3andt>0, 
u(x,0)=x+2 for0 <x <3, 
u(0, t) = u(3,t) =0 for t > 0. 
2 2 


Answer. u(x,t) = >} 


n=1 nr 


co §64-10(-1)" —-7 7 
al 


sin n7x. 


(7.6.6) 
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6. 
Uz = Uxx for0<x <3andt>0, 
u(x,0)=x+2 for0 <x <3, 
u,(0, t) = u,(3,t) = 0 for t > 0. 
7 co 6(-14(-1)") -@™ song 
Answer. u(x,t) = 5+ aa ae COS x. 
7. 
Uy = 2Uyx for0 <x <zandt>0, 
u(x, 0) = cos* x for0<x <7, 
u,(0,t) = u,(7, t) = 0 for t > 0. 
Answer. u(x,t) = : + ~e- 8! cos 2x + we 32 cos 4x. 
8. 
Uy, = 3Uuy, +u for0O<x <2andt>0, 
u(x,0)=1-—x for0 <x <2, 
u,(0, t) = u,(2,t) = 0 for t > 0. 
3(2k-1)2 22 
_— 8 — CDE 41)¢ (2k-l)t 
Answer. u(x,t) = ¥i,_4 Ara cos ———x. 
9. Show that the following functions are harmonic: u(x,y) = a, v(x,y) = 
. . 1 
sin mx sinh my, w(x, y, Z) = ae (a and m are constants). 
10. If u(x, y) is a harmonic function, show that v(x, y) = u (=. =) is also 


harmonic. (The map u(x, y) > u ( 


with respect to the unit circle.) 
11. 
Uxx + Uyy =0 
u(x, 0) = u(x,3) =5 
u(0, y) = u(2, y) = 5 


Hint. Look for a simple solution. 


12. 
Uxx + Uyy = 0 
u(x,0) = 5 
u(x, 3) = 0 


u(0, y) = u(2, y) =0 


x y ) 
x24+y2” x24y2 


is called the Kelvin transform 


for0<x <2and0<y <3, 
for 0 <x < 2, 
for0<y <3. 


for0<x<2and0<y <3, 
for 0 < x < 2, 
for0< x <2, 
for0< y <3. 
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13. 
Uyx +Uyy = 0 for0<x<2and0<y<1l, 
u(x, 0) = u(x, 1) =0 for0<x <2, 
u(0,y)=y for0<y<1, 
u(2, y) =0 forO<y<1. 
14. 
Uxx + Uyy = 0 for0<x<zand0<y<1l, 
u(x, 0) = 0 for0<x <7, 
u(x, 1) = 3sin2x for0<x<z, 
u(0, y) = u(z, y) = 0 forO<y<1. 
Answer. u(x, y) = aoe sin 2x sinh 2y. 
sinh 2 
15. 
Uxx + Uyy = 0 for0< x < 2xmand0<y< 2, 
u(x, 0) = sinx for 0 < x < 2z, 
u(x, 2) =0 for 0 < x < 2z, 
u(0, y) =0 for0< y <2, 
u(2z,y)=y for0<y <2. 
ee F a : io) 4(-1)"+1 
Answer. u(x, y)= ae sinh(y—2) sinx+)) <1 eee 
16. 
Urp — 4Uyx = 0 for0<x<aandt>0, 
u(x, 0) = sin2x for0<x<7Z, 
u(x, 0) = —4 sin 2x for0<x <7, 
u(0, t) = u(z, t) =0 for t > 0. 
Answer. u(x,t) = cos 4t sin 2x — sin 4t sin 2x. 
17. 


Ugt =, 4uy x = 0 
u(x,0) = 0 


u,(x,0) = x 


u(0, t) = u(1,t) = 0 


Answer. u(x,t) = > 


n=1 


co (=1)"+ 


for0<x<landt>0, 
for0 < x <1, 
for0 < x <1, 
for t > 0. 


1 
sin 2nzt sin n7x. 


. n7 . n7v 
sinh 7 xsin)- 
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18. 
Uyp — 4Uxx, = 0 for0<x<landt>0, 
u(x, 0) = —3 for0 < x <1, 
u,(x,0) = x for0 < x <1, 
u(0, ft) = u(1,t) =0 fort > 0. 
Answer. u(x,t) = A |= ((—1)” — 1) cos 2nzt + — sin 2nrt| sin n7x. 
nn nex 


19. Use separation of variables to obtain the solution of 


Uy — CU; = 0 for0 <x <Landt>0, 
u(x, 0) = f(x) for0<x<L, 
u,(x, 0) = g(x) for0<x<L, 
u,(0,t) = u,(L, t) = 0 fort >0 


in the form u(x, t) = dg +Agtt yo, (a, cos at + A, sin mt) cos a and 
express the coefficients as integrals. 


20. Solve 
Uyp — QUxx, = 0 for0 <x <aandt>0, 
u(x,0)=4 for0<x<z, 
u,(x, 0) = cos? x for0<x <7, 
u,(0,t) = u,(z,t) =0 for t > 0. 


1 é 
Answer. u(x,t) =4+ se + ~ sin 6t cos 2x. 


II. Solve the following nonhomogeneous problems. You may leave the complicated 
integrals unevaluated. 


1. 
Uz = SUyx, forO<x<landt>0, 
u(0, t) = 0 for t > 0, 
u(1,t)=1 for t > 0, 
u(x, 0) = 0 for0<x <1. 
_4)n 
Answer, u(x,t)=x+ pee =D" e507 sin nx, 
= n7 
2s 
Uy, = 2Uyx for0 <x < zandt>0, 
u(x,0) = = for0<x <7, 
u(0, t) = 0 fort > 0, 
u(z,t)=1 fort > 0. 


Hint. U(x) = 
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Uz = 2Uyx + 4x 


u(x,0) = 0 
u(0, t) = 0 
u(1,t) =0 


Hint. U(x) = =(x — x3). 


Upp = 4Uyy +X 


u(x,0) = x 
u,(x, 0) = 0 
u(0, ft) =1 
u(4, t) = 3 


Hint. U(x) =1+ "x aR 


24 
5. 
u, = ku,, + f(x, t) for0 <x < zandt>0, 
u(x, 0) = 0 for0<x <7, 
u(0, t) = 0 for t > 0, 
u(z, t) = 0 fort > 0. 
Here f(x, t) is a given function, and k > O is a given number. 
Hint. Expand f(x, t) = as f,() sin nx, with f, (0) = . re f(x, t) sin nx dx. 
7 7 
Writing u(x, t) = ye u,(t) sin nx, one has 
u,, +kn?u, = f,(t), uUp,(0) =0. 
6. Solve 


Uz, = Uy, +t sin 3x 


u(x,0) = 0 
u(0, t) = 0 
u(z, t) =0 


for0O<x<landt>0, 
for0 < x <1, 
fort > 0, 

for t > 0. 


for0<x<4andt>0, 
for0 <x <4, 
for0 <x <4, 
for t > 0, 

for t > 0. 


for0<x<zandt>0, 
for0<x <7, 
fort > 0, 

fort > 0. 


Be NS an 
Answer. u(x,t) = ( eet ~e"%) sin 3x. 
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7.7 Calculating Earth's Temperature and Queen 
Dido’s Problem 


7.7.1 The Complex Form of the Fourier Series. Recall that a real-valued func- 
tion f(x), defined on (—L, L), can be represented by the Fourier series 


nt 
f(x) =a9 + > (a, cos 2 L Mes + b, sin — L x), (7.7.1) 
with 
L L 
1 1 nw 
Ap = xz | fede. a, = z [, fee0s Tx dx 
1 nr 
== f(x)sin —x dx. 
if, r 
eid +e7i8 ei? —e7i8 
and sin @ = as write ((7.7.1}) as 
L 


it™x ~i™yx it™x ajM x 
eL +e L eL —-e L 


f(%) = ay + »y (ae + by 55 


Combining similar terms, we rewrite this as 


Using Euler’s formulas, cos 6 = 


f= Vy cnet, (7.7.2) 


n=—-ow 
where Cy = dy and 
~ 
Leis for n > 0, 
Ch = 
forn <0. 


We see that ¢,, = C_m, for any integer m, where the bar denotes the complex conjugate. 
(The same fact also follows by taking the complex conjugate of ((7.7.2).) 
Using the formulas for a,, and b,, and Euler’s formula, we have for n > 0 


cos ax — isin ra 
“if fo) = fe fojetT* dx. 


In case n < 0, the formula for c,, is exactly the same. 
The series (7.7.2), with the coefficients 


L 
1 a 
=> [ f(xe't*~dx, n=0,+1,+2,..., (7.7.3) 
-L 


is called the complex form of the Fourier series. 
Recall that for any real a 


; eiax 
je dx = ae. +c, (7.7.4) 


as follows by Euler’s formula. 
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Example 7.7.1. Find the complex form of the Fourier series of the function 


—-1 for—-2<x<0O, 
1 for0 <x <2, 


fe) =| 


defined on (—2, 2). 
1 72 , 
Here L = 2. Calculate cg = ae f(x) dx = 0. Using (7.7.3), (7-7.4), and Euler’s 


formula, calculate for n 4 0 
2 


0 nq . AT ; 
Cy = ; (/ (-1)e""2 * dx + [ ie 2" ix) = — [—Le t="), 
=9 0 


so that (with the sum taken over n # 0) 


fos Y Sratcoe?*. 


n=—-oo 


772 The Temperatures Inside the Earth and Wine Cellars. Suppose that 
the average daily temperature in some area, for the tth day of the year, is given by the 
function f(t), 0 < t < 365 (so that t = 34 corresponds to February 3). We assume 
{@ to be periodic, with the period T = 365. What is the temperature x cm inside the 
Earth, for any t? 


u, = ku,., 


x 


The sideways heat equation. 


Assume that x is not too large, so that we may ignore the geothermal effects. Direct 
the x-axis downward, inside the Earth, with x = 0 corresponding to Earth’s surface. 
Direct the t-axis horizontally, and solve the heat equation for u = u(x, f), 


u, = ku,,, u(0,t)= f(t) forx >0Oand—co <t <0. (7.7.5) 


Geologists tell us that k = 2- 19-3 (see [B0]). 

Observe that the “initial condition” is now prescribed along the t-axis and the “evo- 
lution” happens along the x-axis. This is sometimes referred to as the sideways heat 
equation. We represent f(t) by its complex Fourier series (L = - for T-periodic 


: . F T T 
functions, corresponding to the interval (— > a) 


oo , 2n7 
f= D. Ge 
n=—o© 
Similarly, we expand the solution u = u(x, t), 


foe) 


u(x, t) = oS er 


n=—oo 
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The coefficients u,,(x) are complex-valued functions of x. Using this series in ({7.7.5) 
gives for n 4 0: 
2in7 
uy = pup, Upn(0)=cy, with p? = ae (7.7.6) 
Depending on whether n is positive or negative, we can write 


2in = (1 + i)*|nI, 


: . n\7 
Po =QA+iqn, with qn = \/ _ 


(It is plus in case n > 0 and minus for n < 0.) Solving the equation in gives 


Un(X) = ayet*)anx + be AD anx 


and then 


We must set here a,, = 0, to avoid solutions with complex modulus becoming infinite 
as x — oo. Then, using the initial condition in (7.7.6), for n # 0 


U,(X) = cpe~A*Danx, 


In case n = 0, the bounded solution of is 


Ug(X) = Co. 
We obtain 
oe. .[ 2n7 
u(x, t) = y c,e-anX oll tA] (7.7.7) 
n=—oo 
Write c, in its polar form, for n > 0, 
Cn = |cple'¥”, 


with some real numbers y,,, and transform ({7.7.7) as follows: 


09, .( 2n7t .( 2n7 
u(x, t) = co + » e7dnx lene! ar") + a a 
n=1 


é es 
=Cot 2 e7dnx foxes + ce fan) 
n=1 


oO 
2n7 
=Co + yy 2|c,|e~2"* cos (=: +My — Qnx), 
T 
n=1 
using that ¢, = c_, and that z + Z = 2Re(z). 
We see that the amplitude 2|c,,|e~%"* of the nth term is damped exponentially in 
x, and this damping is increasing with n, so that the first term is dominant, giving 


27 
u(x,t) & Co + 2|c,|e~%'* cos (Fr rh 1x) . 


When x changes, the cosine term is a shift of the function cos =, giving us a wave 
along the x-axis. If we select x so that y, — q,x = 0, we have a complete phase shift, 
so that the warmest temperatures at this depth occur in winter (when t ~ 0), and the 
coolest temperatures in summer (when t » T/2 = 182.5). This value of x is a good 
depth for a wine cellar. Not only are the seasonal variations very small, but they will 
also counteract any influence of air flow into the cellar. 
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The material of this section is based on the book of A. Sommerfeld [BO]; see p. 68 of 
that book. I became aware of this application through the wonderful lectures of Henry 
P. McKean at Courant Institute, NYU, in the late 1970s. 


7.73 The lsoperimetric Inequality. Complex Fourier series can be used to prove 
the following Wirtinger’s inequality: any continuously differentiable function x(s), 
which is periodic of period 27 and has average zero, so that ft - x(s) ds = 0, satisfies 


27 


270 
i x*(s) ds < [ x!"(s)ds. 
0 0 


Indeed, we represent x(s) by its complex Fourier series x(s) = }) 
coefficients satisfying x_,, = X, forn # 0 and 


foe) i : 
n= Xne”” with the 


1 27 
= — ds =0. 
Xo al x(s) ds 


Calculate 


27 27 foe} co 
[ eds= | Ge te ds 
0 0 


n=—oo m=—oo 
00 27 
= > xm [ el(nt+m)s ds 
n,m=—oco 0 
foe} 
= 27 >, XypX_y 
n=—oo 
foe} 
= 20 > [als 
n=—oo 


because the integral is ” eiks ds is zero for any integer k # 0 and is equal to 27 for k = 0 


(so that i ellnt+m)s ds is equal to 27 if m = —n and to zero for all other m). 
Since x’(s) = aa inx,e!”, a similar computation gives 


27 oo) 
i x'*(s)ds = 2 yy W1xnl?, 
0 n=—0oo 
and Wirtinger’s inequality follows. (The term corresponding to n = 0 is zero in both 
series. ) 
According to Virgil, Queen Dido of Carthage (circa 800 B.C.) had a long rope to 
enclose land which would become hers. Queen Dido used the rope to form a circle, 
which became the city of Carthage. We shall show that she made the optimal choice: 
among all closed curves of length L, circle encloses the largest area. If a circle has length 
2 

L, then its radius is r = os and its area is zr? = i We wish to show that the area A 
7T 7 
of any region enclosed by a rope of length L satisfies 

2 
oe. 

4a 


This fact is known as the isoperimetric inequality. 


A 
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We may assume that L = 27, corresponding to r = 1, by declaring r = = to be the 
7T 
new unit of length. Then we need to show that the area A of any region enclosed by a 
closed curve of length L = 27 satisfies 
A<7. 


If we use the arc-length parameterization for any such curve (x(s), y(s)), then x(s) and 
y(s) are periodic functions of the period 27 (after traveling the distance 277, we come 
back to the original point on the curve). Recall that for the arc-length parameterization, 


the tangent vector (x’(s), y'(s)) is of unit length, so that x’"(s)+y” (s) = 1 for alls. Then 
he tang (x’(s), y'(s)) is of unit length, so that x’"(s)+y’"(s) = 1 forall s. Th 


27 27 
2x =L= ii 4/ x/2(s) + y’2(s) ds = ‘| [x"*(s) ie y(s)| ds. (7.7.8) 
0 0 


We may assume that y = i ™x(s)ds = 0. (If not, consider the shifted curve 
(x(s) — = y(s)), for which this condition holds.) 

According to Green’s formula, the area A enclosed by a closed curve (x(s), y(s)) is 
given by the line integral f x dy over this curve, which evaluates to f 2 x(s)y’(s) ds. 
Using the numerical inequality ab < a + ~b?, Wirtinger’s inequality, and (7.7.8), we 
conclude 


27 
A= ‘i x(s)y’(s) ds 
7 270 
<5[ [e@+y%@] as 


1 270 
5 [ [x"°(s) + y'°(s)] ds 
0 


=T7, 


lA 


justifying the isoperimetric inequality. 


7.8 Laplace’s Equation on Circular Domains 
Polar coordinates (r, @) will be appropriate for circular domains, and it turns out that 
the Laplacian in the polar coordinates is 
1 1 
Au = Uxy + Uyy = Upp + Ur + 72 H60- (7.8.1) 
To justify (7.8.1), we begin by writing 
u(x, y) = u(r(x, y), Ox, y)), 
with 
r=r(x,y)=vVx2+y2, O@= O(x,y) = arctan _ (7.8.2) 
By the chain rule 
Uy = Uh, + Ug Oy, 


— 2 2 
Uxx = Uprly + 2Uyehx 9x 7 Uge 9 + Uplyx + Ug xx. 
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Similarly 
Uyy = Uprly + 2UpgryOy + Ugg Oy + Uplyy + UgOyy, 
and so 
Uxx + Uyy = Upp (HE +H) + 2Uyo (10x + HyOy) + Ugg (6% + 62) 
+ Ur (Tex + By) + Ue (Oxx + Byy)- 
Straightforward differentiation, using ((7.8.J), shows that 


mw +h =1, 


KO, + HyOy = 0, 


1 

24 92 — 
Oo + = 5, 
1 
Kx thy = ; 
Axx + Oyy = 0, 


and the formula follows. 

We now consider a circular plate: x?+y < R?, orr < Rin polar coordinates (R > 0 
is its radius). The boundary of the plate consists of the points (R, 8), with 0 < @ < 27. 
Assume that the temperatures u(R, @) at the boundary points are prescribed by a given 
function f(), of period 27. What are the steady-state temperatures u(r, @) inside the 
plate? 

We are searching for the function u(r, 8) of period 27 in 6 that solves what is known 
as the Dirichlet boundary value problem (when the value of the unknown function is 
prescribed on the boundary): 


1 1 
Au = Uy, + pur + 72460 = 0, forr < R, 
u(R, 8) = f(@). 


Perform separation of variables, looking for a solution in the form u(r, 8) = F(r)G(@). 
Substituting this u(r, 8) into the equation ({7.8.3}) gives 


(7.8.3) 


F"(r)G(@) + *F'(NG@) = - SFG"). 
Multiply both sides by r?, and divide by F(r)G(6): 
PE (r) +rF (r) _ oe). 


F(r) G(6) fe 
This gives 

G"+AG=0,  G(@) is 27 periodic, 
; (7.8.4) 
r°F"(r) + rF'(r) — AF(r) = 0. 


The first problem, of eigenvalue type, was considered in a problem set previously. It has 
nontrivial solutions when A = /,, = n? (nis a positive integer) and when A = Ay = 0 
and these solutions are 


G,(@) = A, cosn6 + B, sinn@, Go = Ao, 


7.8. Laplace’s Equation on Circular Domains 299 


with arbitrary constants Ag, A, and B,. The second equation in (7.8.4), when A = 
An =n’, becomes 
YF" (r) + rF'(r) — n?F(r) = 0. 

This is Euler’s equation! Its general solution is 

F(r) = cr" +er7". (7.8.5) 
We need to select c. = 0, to avoid infinite temperature at r = 0, so that F,(r) = r”. 
When A = Ay = 0, the second equation in is 

rF"(r) +rF'(r) =0, 


for which the general solution is F(r) = c, Inr + cy. Again, we need to select c; = 0, 
and then /(r) = 1. The function 


u(r, 0) = Fo(r)Gp(8) + y F,(r)G,(@) = Ap + y r” (A, cos né + B,, sin né) 


n=1 n=1 


satisfies the Laplace equation for r < R. The boundary condition requires 


u(R, 8) = Ag + >, R" (A, cosné@ + B, sinn@) = f(9). 


n=1 
Expand f(@) in its Fourier series 
f@=ayo+ > (a, cosné + b, sinné), (7.8.6) 
n=1 


with the coefficients 


l 2a 1 20 
Ap = ral f(@)d@, a,= = { f(8) cos né dé, 
0 9 (7.8.7) 


27 
pee i f(@)sinnod@ (n> D). 
T Jo 
(For 27-periodic functions, integrals over (—7, 7) are equal to the corresponding inte- 


grals over (0, 277).) Then we need to select Ag = ag, A,R” = ay, and B,R" = by, so 
that A, = =n and B, = =n. Conclusion: the solution of (7.8.3) is given by 


bc) n 
u(r, 0) = Ag + » (5) (a, cosn@ + b, sinné), (7.8.8) 
n=1 


with the coefficients calculated by (7.8.7). 
We see that the solution of ({7.8.3) can be obtained from the Fourier series of f(8), 


n 
by just putting in the additional factors, (- . Observe also that f(@) needs to be 
defined only on (0, 27), according to (7.8.7), so that the requirement that f(@) is 27- 


periodic can now be removed. 
Example 7.8.1. Solve 
Au =0 for x? +y? <4, 


u=x*-3y onx?+y?=4, 
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Using that x = 2cos @ and y = 2sin @ on the boundary, write 
f(@) =x? — 3y = 4cos? 6 — 6sin @ = 2 + 2cos 26 — 6sin@. 


The last function is its own Fourier series, with ag = 2, a, = 2, b} = —6, and all other 
coefficients are zero. The formula gives the solution (here R = 2): 


ry r 1 
u(r, @) = 2+ 2(=) cos 26 — 6= sin@ = 2 + =r? cos 26 — 3rsin 0. 
2 2 2 
In Cartesian coordinates this solution is (using that cos 26 = cos” 6 — sin’ 6) 


1 
u(x, y) = 2+ ios — y*) —3y. 
Consider next the exterior problem 


1 1 
Au = Uy, + Ur + “zee = 0, forr > R, 


u(R, 8) = f (8). 

Physically, we have a plate with the disc r < R removed. Outside of this disc, the plate 
is so large that we can think that it extends to infinity. Temperatures are prescribed by 
f(@) on the boundary of the plate, and the solution of will give the steady-state 
temperatures. 

Perform separation of variables following the same steps as above, and in 
this time select c, = 0, to avoid infinite temperatures as r — oo. Conclusion: the 
solution of the exterior problem is given by 


(7.8.9) 


foe} R n 
u(r, @) = ag + b> (=) (a, cosné + b, sinné), 
n=1 


with the coefficients taken from the Fourier series of f(@), as given in (7.8.7). Again, 
going from the Fourier series of f(@) to the solution of involves just putting in 
n 


the additional factors (=) . 
r 


Example 7.8.2. Solve the exterior problem (R = 3) 
Au =0, for x? +y?>9, 


2 onx* +y? =9. 


u=x 

Writing f(@) = x” = (3cos 6) = 9cos? 6 = : + = cos 26, obtain 
9-948! , (cos? 6 — sin? ) 9 
26 = = 4+ —— = Yt 
cos 5 + 5 = 5 + 
Consider next the Neumann boundary value problem 

1 1 
Au = Upp + Ur + “zee = 0, forr<R, 
u,(R, 8) = f(@). 


It describes the steady-state temperatures inside the disc r < R, with the heat flux f(@) 
prescribed on the boundary of the disc. By separation of variables, obtain as above 


(7.8.10) 


u(r, 8) = Ag + > r” (A, cosné + B, sinné). (7.8.11) 


n=1 
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The boundary condition requires 


u,(R,@) = }) nR"~! (A, cosné + B, sinn@) = f(6). (7.8.12) 


n=1 
This is impossible to arrange, unless the constant term is zero in the Fourier series of 
f(®@), which implies that 


27 
[ f(@)d0 = 0. rasta 
0 


(Observe that the constant term is zero in the series on the left in (7.8.12). The same 
must be true for f(@) on the right.) The condition is a necessary condition for 
the Neumann problem to have solutions. If the condition holds, we choose A,, 
and B,, to satisfy nR" 1A, = = fe f(@) cosn@dé@ and nR"-!B, = ~ lee f(€)sin néde, 
while Ag is arbitrary. at - 

To recapitulate, the Neumann problem is solvable only if the condition 
holds; otherwise it has no solutions. If the condition holds, the formula 
gives infinitely many solutions (“feast or famine”). 


7.9 Sturm-Liouville Problems 


Let us recall the eigenvalue problem 
y"+aAy=0, 0<x<L, 
y(0) = y(L) = 0, 
on some interval (0, L). Its eigenfunctions, sin x n= 1,2,..., are the building blocks 
of the Fourier sine series on (0,L). These eigenfunctions are orthogonal on (0, L), 
which means that cE sin nx sin x dx = 0 for any m # n. Similarly, the eigen- 
functions of 
y"+aAy=0, 0<x<L, 
y'(0) = y'(L) = 0, 
which are 1, cos x. n = 1,2,..., give rise to the Fourier cosine series on (0, L). It turns 


out that under some conditions, solutions of other eigenvalue problems lead to their 
own types of Fourier series on (0, L). 
Recall that given a general linear second-order equation 


P(x)y" + Qd)y' + ROx)y = 0, 
with P(x) > 0, one can divide this equation by P(x) and then multiply by the integrating 


S QO) ax 
P@) , to put it into the selfadjoint form 


(p(x)y’)' + r(x)y = 0, 


factor p(x) =e 


with r(x) = poe. 
x 
On an arbitrary interval (a, b), we consider an eigenvalue problem for equations 


in the selfadjoint form 


(p(x)y’) +Ar(x)y = 0, fora<x <b, (7.9.1) 
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together with the homogeneous boundary conditions 


ay(a)+ By'(a)=0, yy(b)+ dy'(b) = 0. (7.9.2) 
The differentiable function p(x) and the continuous function r(x) are given, and both 
are assumed to be positive on [a, b]. The boundary conditions in are called sep- 
arated boundary conditions, with the first one involving the values of the solution and 
its derivative only at x = a, and the other one uses the values only at the right end point 
x = b. The constants a, 8, y, and 6 are given; however, to prevent the possibility that 
both constants in the same boundary condition are zero, we assume that a? + - #0 
and y* + 6* # 0. By the eigenfunctions we mean nontrivial (nonzero) solutions of 
(7.9.1), satisfying the boundary conditions in (7.9.2), and the corresponding values of 
A are called the eigenvalues. 


Theorem 7.9.1. Assume that y(x) is an eigenfunction of the problem (7.9.1), (7.9.2), cor- 
responding to an eigenvalue A, while z(x) is an eigenfunction corresponding to an eigen- 
value p, and A # pw. Then y(x) and z(x) are orthogonal on (a, b) with weight r(x), which 


means that ‘ 


[ y(x)a(x)r(x) dx = 0. 


a 
Proof. The eigenfunction z(x) satisfies 
(p(x)2') + ur(x)z = 0, 
az(a)+ B2'(a)=0, yz(b)+6z'(b) =0. 


Multiply the equation ({7.9.1) by z(x), and subtract from that the equation (7.9.3) mul- 
tiplied by y(x). We obtain 


(pQx)y'Y' 2x) — (pO)2') yx) + A= wr)y(x)z(x) = 0. 


Rewrite this as 


(7.9.3) 


[pO’z — y2')]' + A—wrdy@)a(x) = 0. 
Integrating over [a, b] gives 


b 
[eo'2— yz", += w) | yodeCr(a)ax = 0. (7.9.4) 
We shall show that 
p(b)(y'(b)z(b) = y(b)z"(b)) = 0 (7.95) 
and 
pla) (»"(a)z(a) — y(a)z'(a)) = 0. 7.9) 


Then the first term in is zero. It follows that the second term in is also 
zero, and therefore f y(x)z(x)r(x) dx = 0, because A — wp #0. 

We shall justify (7.9.5), while the proof of is similar. Consider first the case 
when 6 = 0. Then the corresponding boundary conditions simplify to read y(b) = 0, 
z(b) = 0, and follows. In the other case, when 6 # 0, we express y’(b) = — : y(b), 


z'(b) = —52(b), and then 
y'(b)2(b) ~ y(b)2"(b) = —Ly(b)2(b) + Lyb)a(b) = 0, 
and follows, which concludes the proof. © 
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Theorem 7.9.2. The eigenvalues of the problem (7.9.1), are real numbers. 


Proof: Assume, to the contrary, that an eigenvalue A is not real, so that A # A, and the 
corresponding eigenfunction y(x) is complex valued. Taking the complex conjugates 


of and gives 
(py + Ar@oy = 0, 
ay(a) + By'(a) = 0, 
¥(b) + dy'(b) = 0. 


It follows that / is also an eigenvalue and j is the corresponding eigenfunction. By the 
preceding theorem, Theorem [7.9.1 


j 


The second integral involves a nonnegative function, and it can be zero only if y(x) = 0, 
for all x. But an eigenfunction cannot be a zero function. We have a contradiction, 
which was caused by the assumption that / is not real. It follows that only real eigen- 
values are possible. © 


b 
yQopo)r(x) dx = l Coe dee: 


Example 7.9.1. On the interval (0, 7), we consider the eigenvalue problem 


y"+Ay=0, 0<x<zZ, 


; (7.9.7) 
yO) = 0, y'(z) — yx) = 0, 
and calculate its eigenvalues and the corresponding eigenvectors. 
The general solution depends on the sign of A. 
Case 1(A < 0). We may write 2 = —k?, with k > 0. The solutions satisfying the 


equation and the first boundary condition are y = csinhkx. The second boundary 
condition requires that k cosh kz = sinh kz, or 


tanh kz = k. 


Let ky be the unique positive solution of this equation. Then 2 = —k? is an eigenvalue, 
and y = sinh kpx is the corresponding eigenfunction. 


Case 2(A = 0). The general solution is y = c)x + cy. Calculate c; = c, = 0, anda =0 
is not an eigenvalue. 


Case 3 (A > 0). We may write A = k?, with k > 0. The general solution is then 
y = c,coskx + c,sinkx, and c,; = 0 by the first boundary condition. The second 
boundary condition implies that 


C2 (k cos kz — sinkz) = 0. 
We need c, # 0 to get a nontrivial solution; therefore, the quantity in the bracket must 


be zero, which implies that 
tankz =k. (7.9.8) 


This equation has infinitely many solutions, 0 < k; < k, < k3 < ..., as can be seen 
by drawing the graphs of y = k and y = tankz in the ky-plane. We obtain infinitely 
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many eigenvalues 4; = k?, and the corresponding eigenfunctions y,; = sinkjx, i = 
1, 2, 3,.... (Observe that the —k;’s are also solutions of (7.9.8), but they lead to the same 
eigenvalues and eigenfunctions.) Using that tank;z = k;, or sink;z = k; cosk,z, and 
recalling two trigonometric identities, we verify that for alli 4 j 


ya 7 
[ sin k;x sin kjx dx = ; [ [cos(k; — kj)x — cos(k; + kj)x| dx 


sin(k; —kj)a — sin(k; + kj)z 
2(k; — kj) 2(kj + kj) 


1 . 
= ee 7 i? (kj cos kj sin ky — k; cos kj sin kj) = 0, 


proving directly that the eigenfunctions are orthogonal, which serves to illustrate The- 


orem above. 


It is known that the problem (7.9.1), has infinitely many eigenvalues, and 
the corresponding eigenfunctions y;(x) allow us to do Fourier series. This means that 


we can represent on the interval (a, b) any f(x), for which hg f?(x)r(x) dx is finite, as 


foe) 


f= Wy» G(x), fora<x <b. (7.9.9) 
j=1 


One says that the eigenfunctions y;(x) form a complete set. To find the coefficients, mul- 
tiply both sides by y;(x)r(x) and integrate over (a, b): 


b 00 b 
i fyiCOr) dx = Dig | yOodyi(x)r(x) dx. 
a j=l a 


By Theorem for all j # i, the integrals on the right are zero, so that the sum on 
the right is equal to c; f y?(x)r(x) dx. Therefore, 


G= i SX) yi()rx) dx 
Se yPor(x) dx 


For the example considered above, the corresponding Fourier series takes 
the form 


(7.9.10) 


ce 
f@) =co sinh kpx + > c; sin kx, for0O<x <7, 
i=1 


for any f(x) satisfying i, f?(x) dx < oo, with the coefficients 


i f(x) sinh kyx dx 
ee 


7 So f(x) sink;x dx 
So sinh” kox dx 


and ¢; oS 
Jo Sin’ kx dx 


, fori>1. 


Using a symbolic software, like Mathematica, it is easy to compute approximately the 
k;’s and the integrals for the c;’s. The book of H. Weinberger [B4] has more information 
on the validity of the expansion ({7.9.9). 
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7.9.1 The Fourier-Bessel Series. Consider the following eigenvalue problem: on 
the interval (0, R) determine nontrivial solutions F = F(r) of 


1 


FU + =a +AF =0, 
F'(0) = 0, (7.9.11) 
F(R) =0. 


Rewrite this equation in the selfadjoint form ({7.9.1)) as 
(rF’) +ArF =0. 


Then, by Theorem 7.9.1] any two eigenfunctions of (7.9.11), corresponding to different 
eigenvalues, are orthogonal on (0, R) with weight r. 

We shall reduce the equation in to Bessel’s equation of order zero. To this 
end, make a change of variables r > x, by letting r = a By the chain rule 


Va 
f= EVA, Fry = FA. 
Then the problem ({7.9.11)) becomes 
AF + VE, +AF =0, 
Fi 
E,(0) = 0, 
F(VAR) = 0. 


Divide by A, and use primes again to denote the derivatives in x: 


1 
Pe te = 0, 


F'(0) =0, 
F(VaR) = 0. 


This equation is Bessel’s equation of order zero. The Bessel function Jo(x), which was 
considered in Chapter f} satisfies this equation, as well as the condition F’(0) = 0. 
Recall that the function Jo(x) has infinitely many positive roots, <<< --. In 
order to satisfy the second boundary condition, we need 


VAR=nr, i=1,2,3,.., 


2 
so thata = A; = = Returning to the original variable r (observe that F(x) = F(Van) 
gives us the eigenvalues and the corresponding eigenfunctions of the problem (7.9.11): 
2 
a _7(ii 5 as 
A= i AO =Io(Zr), i=1,2,3.,.... 
The Fourier-Bessel series is then the following expansion, using the eigenfunctions 


Jy (1): 


fi) = 2h (47), ford <r <R, (7.9.12) 
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and the coefficients c; are given by (in view of ({7.9.10)) 


_ So Oo ryrdr 


¢, = (7.9.13) 
a Jg(Sryrdr 


This expansion is valid for any f(r), with Us f’?(@)rdr finite. Using Mathematica, it is 
easy to compute the c,;’s numerically and to work with the expansion (7.9.12). 


7.9.2 Cooling of a Cylindrical Tank. It is known that the heat equation in three 
spacial dimensions is (see, e.g., the book of H. Weinberger [B6]) 


Up =K(Uyy +Uyy+Uzz), k > Oisaconstant. 


Suppose that we have a cylindrical tank x? + y* < R*,0 < z < H, and the temperatures 
inside it are independent of z, so that u = u(x, y, t). The heat equation then becomes 


Uy = k(Uyx + Uyy). 


Assume also that the boundary of the cylinder is kept at zero temperature, while the 
initial temperatures, u(x, y,0), are prescribed to be f(r), where r is the polar radius. 
Because the initial temperatures do not depend on the polar angle 9, it is natural to 
expect that u = u(x, y, t) is independent of 6 too, so that u = u(r, t). Then the Laplacian 
becomes 


1 1 1 
Uxx 4 Uyy = Urry + eo + 2 “00 = Upr + ae 


Under these assumptions, we need to solve the following problem: 


ty = Ke (upp + <u) for0<r<R,andt > 0, 
u,(0,t)=0, u(R,t)=0  fort>0, (7.9.14) 
u(r,0) = f), 


with a given function f(r). The condition u,(0,t) = 0 was added, because we expect 
the temperatures to have a critical point in the middle of the tank, for all time t. 

Use separation variables, writing u(r, t) = F(r)G(t). Substitute this product into 
our equation and then divide both sides by kF(r)G(t): 


F(NG'(t) =k (Fr) nm “F'(”) G(t), 


cy) _ F'O+ *F'(r) - 
kG(t) F(r) a 


which gives 


1 
FU + a +AF =0, 


F'(0) =0, (7.9.15) 
F(R) = 0, 
and 
eg, (7.9.16) 


kG(t) 
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The eigenvalue problem ({7.9.15}) for F(r) was solved in the preceding section, giving 


2 5 
the eigenvalues A; = = and the corresponding eigenfunctions K(r) = Jy(Fr). Using 
ae 
A=A,;= = in (7.9.16), compute 
kh 
G,(t) = cje RZ, 
The function 


co r2 
kit hj 
u(r, t) = yy ce *R*7, (Zr) (7.9.17) 
i=1 


satisfies our equation and the boundary conditions. The initial condition 
— ij 
= j(tr)= 
u(r, 0) = X ciJo (Fr) fr) 


will hold if we choose the c;’s to be the coefficients of the Fourier-Bessel series, given 
by (7.9.13). Conclusion: the series in (7.9.17), with the c;’s computed by (7.9.13), gives 


the solution to our problem. 


7.9.3 Cooling of a Rectangular Bar. Consider a function of two variables f(x, y) 
defined on a rectangle 0 < x < L,0 < y < M. Regarding x as a primary variable, we 
may represent f(x, y) by the Fourier sine series on (0, L): 


es _ nw 
fGuy) = D) insin =x, (7.9.18) 
n=1 
where 
2 : na 
t -7{ f(x, y) sin —x dx. 
"Ld, i 


Clearly, each f,, is a function of y, f, = f,(y). We now represent f,,(y) by the Fourier 
sine series on (0, M): 


= _ mn 
In) = D7 bum sin = -Y> (7.9.19) 
m=1 
with the constants 
M 
2 . Mma 
Dum = val nO) sin mM dy. 


Using (7.9.19) in (7.9.18), we obtain the double Fourier sine series 


fy) = oy > bym Sin nt xsin my, 
n=1m=1 L M 
where 
.¢° 7 nt mr 
Bam = im [ [ f(x, y) sin 7 *sin Fry dx dy. (7.9.20) 


Similarly one could develop the double cosine series, or mixed “sine-cosine” series. 
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Next, we solve the problem (for u = u(x, y, t)) 
Uy =k(Uy, +Uyy), O<x<L, 0<y<M, 
u(x, 0,t) = u(x,M,t)=0, O<x<L, 
u(0, y,t) = u(L, y,t)=0, O<y<M, 
u(x, y,0) = f(x,y), 
describing cooling of a rectangular plate, with all four sides kept on ice (temperature 
zero) and with the initial temperatures prescribed by a given function f(x, y). 


Use separation of variables, setting u(x, y, t) = F(x)G(y)H (ft) in our equation, and 
then divide by kF(x)G(y)H(t): 


A(t) _ F'(x) | GY) _ 


—_ = —~ =-A. 7.9.21 
KA® ~ F@) * GO) ii 
The first of these relations gives 
At) _ 
ao Me (7.9.22) 


F"(x) | G"(y) _ 


In the second one, —A, we separate the variables further: 


F(x) GQ) 
FQ), _ GO __, 
F(x) G(y) 
which gives the familiar eigenvalue problems 
F" + uF =0, 0<x<L, F(0) = F(L) = 0, 
G4 A=pe=0, 0<y <M, G(0) = G(M) = 0. 

It follows that zy, = =, B(x) = sin “x, and then Anm = = + ™™, Gam(y) = 
t follows that u, = rear (x) = sin —-x, an then Aym = aT ee nm) = 
n272 m2 72 
ak D2 eZ 

sin ae From (7.9.22), Hn (t) = e ( ate a The sum 
ie -K( +e nq mr 
u(x, y, t) = > Dyme SM? sin 7% sin a 


n=l1m=1 


with the coefficients b,,,, computed by gives the solution of our problem. 


7.10 Green's Function 
We wish to solve the nonhomogeneous boundary value problem 
(pOoy'y +r@dy =f), a<x<b, 
y(a) = 0, (7.10.1) 
y(b) = 0, 


where the equation is written in selfadjoint form. Here p(x), r(x), and f(x) are given 
differentiable functions, and we assume that p(x) > 0 and r(x) > 0 on [a, b]. We shall 
also consider the corresponding homogeneous equation 


(p(x)y’) + r(x)y = 0 (7.10.2) 
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and the corresponding homogeneous boundary value problem 


(p(x)y') + r(x)y = 0, 
y(a) = 0, (7.10.3) 
y(b) = 0. 


Recall the concept of the Wronskian determinant of two functions y,(x) and y,(x), or 
the Wronskian, for short: 


W(x) — | V(x) Y2(x) 


yy (x) yh (x) = yi(x)y3(x) — yi (x)y2(x). 


Lemma 7.10.1. Let y,(x) and y2(x) be any two solutions of the homogeneous equation 


(7.10.2). Then p(x)W(x) is a constant. 


Proof. We need to show that ( p(x)W(x))’ = 0. Compute 
(p(x)W(x)) = yi PCdy2 + 1 (POCO) — PRL — (POD) Y2 
= y, (p()y5) — (POD) Y2 = POO Y2 + (H)1Y2 = 0. 


In the last step we expressed ( p(x)yt)’ = —r(x)y, and ( p(x)y5)’ = —r(x)y2, by using 
the equation (7.10.2), which both y, and y, satisfy. © 


We make the following fundamental assumption: the homogeneous boundary value 
problem has only the trivial solution y = 0. Define y,(x) to be a nontrivial 
solution of the homogeneous equation (7.10.2), together with the condition y(a) = 0 
(which can be computed, e.g., by adding a second initial condition y'(a) = 1). By 
our fundamental assumption, y,(b) # 0. Similarly, we define y,(x) to be a nontrivial 
solution of the homogeneous equation together with the condition y(b) = 0. 
By the fundamental assumption, y,(a) # 0. The functions y,(x) and y,(x) form a 
fundamental set of the homogeneous equation (they are not constant multiples 
of one another). To find a solution of the nonhomogeneous equation (7.10.1), we use 
the variation of parameters method and look for a solution in the form 


YX) = Uy (x) yi (x) + U2 (x) y2 (22), (7.10.4) 


with the functions u,(x) and u,(x) satisfying the formulas (7.10.4) and ({7.10.7) below. 
We shall additionally require that these functions satisfy 


u,(b) =0, up(a) =0. (7.10.5) 
Then y(x) in (7.10.4) satisfies our boundary conditions y(a) = y(b) = 0 and gives the 


desired solution of the problem ({7.10.1). 
We put the equation (7.10.1) into the form considered in Chapter 


rye OD pg OS) 
ope)” * pa)” ~ PRY’ 

Then by the formulas (2.8.5), we have 

_aCOFC) _ — ywCdFC) 

p(x)W(x) Kk” 

WOOFC) _ ViCAFO) 

p(x)W(x) Kk” 


u(x) = (7.10.6) 


u4(x) = (7.10.7) 
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where W is the Wronskian of y,(x) and y,(x), and by K we denote the constant that 
p(x)W (x) is equal to, by Lemma 
Integrating (7.10.7) and using the condition u,(a) = 0, we get 


ae [ WFO gg 


a 


Similarly, integrating (7.10.6) and using the condition u,(b) = 0 gives 


ate [ wOLG ge 


Using these functions in (7.10.4), we get the solution of our problem (2.10.1): 
b x 
yod= ny [BPO ree yo) [ MMOGs 08) 
x a 


It is customary to define Green’s function 


yi(x)y2(§) fora<x<é 

_ K See 
G(x, g) an y2(x)y1 (€) foe E < ‘ 2 i (7.10.9) 

K _ —_— ’ 

so that the solution (7.10.8) can be written as 
b 
yo) = [ow Or @d8. (7.10.10) 
a 


(Break up this integral as x a fr + ae In the first integral, § < x, so that G(x, &) is 
given by the second formula in ((7.10.9).) 


Example 7.10.1. Find Green’s function and the solution of the problem 
y’+y=f), for0<x <1, 
yO) =0, yO) = 
The function sin(x — a) solves the corresponding homogeneous equation y” + y = 0, 
for any constant a. Therefore, we may take y,(x) = sin x and y,(x) = sin(x — 1) (giving 
y1(0) = y2(1) = 0). Compute 
W = y,(x)¥3(x) — yj (x)y2(x) = sin x cos(x — 1) — cos x sin(x — 1) = sin 1, 

which follows by using that cos(x — 1) = cosxcos1 + sinxsin1 and sin(x — 1) = 


sin x cos 1 —cosxsin1. Then 


sin x sin(€—-1) 


G(x, é) — sinl 


sin(x—1) sin & for E <x <1, 
sinl 


for0<x <6, 


and the solution is 


1 
roe i Gx, Of (Oak. 
0) 


Example 7.10.2. Find Green’s function and the solution of the problem 
xy" — 2xy’ + 2y = f(x), forl <x <2, 
y) =0, (2) =0. 
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The corresponding homogeneous equation 
xy" — 2xy’ +2y =0 
is Euler’s equation, with the general solution y(x) = cx + c,x”. We then find y,(x) = 
x — x? and y,(x) = 2x — x? (y,(1) = y,(2) = 0). Compute 
W = yi(e)ya(x) — y)ya(X) = (x — x?)(2 — 2x) — (1 — 2x)(2x — x?) = x? 


Turning to the construction of G(x, &), we observe that our equation is not in the self- 
adjoint form. To put it into the right form, divide the equation by x?: 


2 
and then multiply the new equation by the integrating factor, 1 = efx) L p-2inx = 


1 mat 
a obtaining 


iy) +r 


Here p(x) = a and K = p(x)W(x) =1. Then 
x 


7 (x —x?)(2é -&7) forl<x<é, 
Ce) = i —x*\(€-£&) foré<x <2, 
and the solution is 
2 
_ FS) 
y(x) = i ocx, ar. 


Finally, we observe that the same construction works for general separated bound- 
ary conditions ((7.9.). If y,(x) and y,(x) are the solutions of the corresponding homoge- 
neous equation, satisfying the boundary conditions at x = a and at x = b, respectively, 
then the formula (7.10.9) gives Green’s function. 


7.10.1 Problems. 


I. Find the complex form of the Fourier series for the following functions on the given 
interval. 


1. f(x) = x on (—2, 2). 


i(—])n ; 27 

Answer. x = ae ae 2, 
~ n7 

2. f(x) = e* on (-1, 1). 


a3 (1+inz)(e- =) 


Answer, e* = —1)" —__—__¢* ginax, 
eer 2in=~col ) 2(1+n272) 


3. f(x)= sin’ x on (—7, 7). 


1 lol; 
Answer, —-e7!2% 4 = — =@!2*, 
4 2 4 
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4. f(x) = sin 2x cos 2x on (—7/2, 2/2). 


i _; i 
Answer. 7e 14x 7. 


5. Suppose a real-valued function f(x) is represented by its complex Fourier se- 
ries on (—L, L): 


{=D Gea 
n=—oo 
(i) By taking the complex conjugates of both sides, show that ¢, = c_, for 
all n. - 
(ii) Multiply both sides by et *,and integrate over (—L, L), to conclude 
that 


L 
1 _ nt 
jaa | faje Fr dx. WSO too 
aL J, 


6. Let u(t) be a differentiable function of period T, satisfying ie u(t)dt = 0. 
Prove the following Poincaré inequality: 


r ; 
ju(t)| < - (/ u'(t) ct) for all t. 


. 270 
Hint. Represent u(t) by its complex Fourier series: u(t) = >} ee cer” (with 


oe 22 j= 
Co = O by our condition). Then w(t) = ba go ie NCne rT and 
Ty 472 : o 1 a 
Joe (Hats = days n?|c,|*. We have (using that >) _, a= =) 


; ; T ; 

1 avVT 2 
j= Fial<( y= ten?) =A (furore 
mel le (53 (Zeist YE ([ wear) 


II. Solve the following problems on circular domains, and describe their physical sig- 
nificance. 


1. 
Au=0, r< 3, 
u(3, 6) = 4cos? 6. 


Answer. u= 2+ =r? cos20 =2+ =(x? — a), 


Au=0, r>3, 
u(3, 6) = 4cos? 6. 


x2—y2 
(x2+y2)2° 


Answer. u=2+ + cos 26 = 2418 
r 
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3. 
Au=0, r<2, 
u(2, 0) = y?. 
Answer. u = 2— = (x? —y?). 
4. 
Au=0, r>2, 
u(2, 0) = y?. 
=. a x22 
Answer. u = 2 8a 
5. 
Au=0, r<l, 
u(1, 6) = cos* 6. 
‘ 1+cos 20 2 
Hint. cos* @ = (a) . 
2 
6. 
Au=0, r<1l, 
u(1, 0) = 0. 
Hint. Extend f(@) = @ as a 27 periodic function, equal to @ on [0, 27]. Then 
ee hie er a 1 
a, = = [_£@cosneas = a f(@) cos néd0 = = 


and compute similarly aj and the b,,’s. 
_ co 27. 
Answer. u=7—) 4 or" sin ne. 


7. Solve the exterior problem 
Au=0, r>3, 
u(3, 6) = 6 +2. 


co 3f 
Answer. u=2z+2-—2 Dit —r-" sin né. 
a n 


8. Solve the problem, and write the answer in the Cartesian coordinates 


Ux, tUyy =0 insider < 2, 


u=x?—-y onr=2. 


Answer. u(x, y) = 1+ - (x? -y?) +y. 


270 
i 6 cos nédée, 
0 
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9. Find the steady-state temperatures inside the disc x? + y* < 9, if the temper- 
atures on its boundary are prescribed by the function y? — x. 


Answer. u(x, y) = ; —-x- s(x? —y’). 


10. Determine if the following Neumann problem is solvable, and if it is, find its 
solutions: 


Au=0, r<3, 
u,(3, 8) = sin @ cos @ — 2sin 30. 


ae eae 
Answer. u = =I sin 20 — ar sin 30 +c. 


11. Determine if the following Neumann problem is solvable, and if it is, find its 
solutions: 
Au=0, r<l, 
u,(1, @) = sin’ 6 — 2sin 36. 
Ill. 1. Find the eigenvalues and the eigenfunctions of 


y"+ay=0, = yO)+YO)=0, yr) +y'(z) =0. 


Answer. Ayn =n’, yy = sinnx — ncosnx, and also A = —1 with y = e~™*. 


2. Identify graphically the eigenvalues, and find the eigenfunctions of 
y"+ay=0, = y(0)+y'(0) = 0, (a) = 0. 
3. (i) Find the eigenvalues and the eigenfunctions of (a is a constant) 


y" +ay' +Ay =0, y(0) = y(L) = 0. 


a* — n*72 -2x . nn 
Answer. A, = =a + Ta Ya) =e 2° sin —x. 


(ii) Use separation of variables to solve 
Uz = Uy, taU,, O<x<L, 
u(0, t) = u(L, t) = 0, 


u(x, 0) = f(x). 
(S+55) a 
Answer. u(x,t) = ee b,e \4 © /e72* sin =X, with b, = 


2. abe 2X o. Ae. 
= 5} = 
7 e2° f(x)sin a x dx. 


4. (i) Find the eigenvalues and the eigenfunctions of 


xy" + 3xy’ +Ay =0, y(1) = y(e) = 0. 


Answer. Ay = 1+n?7x*, y,(x) = x7! sin (nz1n x). 
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(ii) Put this equation into the selfadjoint form ( p(x)y’) + Ar(x)y = 0, and 
verify that the eigenfunctions are orthogonal with weight r(x). 


Hint. Divide the equation by x’, and verify that x? is the integrating 
factor, so that p(x) = x? and r(x) = x. 
(iii) Use separation of variables to solve 
Uy = X27, +3XUz, 1<x<e, 
u(1, t) = ule, t) = 0, 
u(x, 0) = f(x). 


_y hie _ fi fOyn(x)x dx 
Answer. u(x,t) = Dinat bye Yn(X), bn = Si yatx)xdx * 


5. Show that the eigenfunctions of 
y™ +ay=0, yO) = yO) = yL) = y') = 0, 


corresponding to different eigenvalues, are orthogonal on (0, L). 


Hint. 


mw wa d mt Nyt Pimglt 


yz ya = (y"z—y"z + y'z" —yz"). 


6. Consider an eigenvalue problem 


(px)y')’ + Ar(x)y =0, — ay(0) + By'(0) = 0, yy(z) + dy") = 0. 
Assume that the given functions p(x) and r(x) are positive, while a and f are 
nonzero constants of different sign and y and 6 are nonzero constants of the 
same sign. Show that all eigenvalues are positive. 


Hint. Multiply the equation by y(x) and integrate over (0,7). Perform an 
integration by parts. 


7. Find the eigenvalues and the eigenfunctions of (u = u(r)) 


u(r) + 20) +dAu(r)=0, O<r<az, w(0)=u(z) =0. 


Hint. Write the equation in the form (ru)” + A (ru) = 0. 


sinmr 
Answer. A, = m?, u,,(r) = == 1223.55, 


8. Find the eigenvalues and the eigenfunctions of 
n—-l 
r 
where n is a positive integer. 


u(r) + u'(r)+Au(r)=0, O<r<i1, w(O)=u(1)=0, 


2-n 
Hint. The change of variables u(r) = r 2 v(r) transforms this equation into 
Bessel’s equation of order =, with solution u(r) = Jn-2 (va ). 
2 


316 Chapter 7 The Fourier Series and Boundary Value Problems 


2-n 
Answer. u,,(r) = r 2 pee (2x2, r), An = n-2 » M = 1, 2, 3,..., where 
a 


An-2 ,, denotes the mth root of Jn-2(r). 
2°? 2 


9. Find the eigenvalues and the eigenfunctions of (F = F(t), a is a constant) 


i 
F" + (F' + AF =0, 0<t<1, F’(0)=F(I)=0 


a+1 
Hint. Show that the change of variables r = —— transforms this problem into 
a 


(7.9.11), with R = —-. 


at+1 


Answer. A; = (a+ 1)?7, B = Jo (nt**"), where the 7; are the roots of Jo. 


10. Solve 
Up = 3(Uyy +Uyy), O<xX<7,0<y<zZ, 
u(x, 0,t) = u(x,7,t)=0, O<x<z, 
u(0,y,t) = u(z,y,t)=0, O<y<z, 


u(x, y,0) = sin xcosx sin y. 
1 -15t « : 
Answer. u(x, y,t) = 5° sin 2x sin y. 


11. (i) Solve 

Up =Uyx +Uyy, O<xX<3,0<y<2, 
u(x, 0,t) = u(x,2,t)=0, 0<x <3, 
u(0, y,t) =u(3,y,t)=0, O<y<2, 


u(x, y,0) = xy—-y. 


Answer. 
os 22 28 
8(—1)™ 16(—-1)"*™ ("7 mer ; ; 
u(x, y, t) = > scene ( 9 4 ) sin xin ay. 
nym=1 


(ii) Find the eigenvalues and the corresponding eigenfunctions of the Lapla- 
cian on the rectangle (0, 3) x (0, 2) 


Uxx tUyytAu=0, 0<x<3,0<y<2, 
u(x, 0,t) = u(x,2,t)=0, 0<x <3, 
u(0, y,t) = u(3,y,t)=0, O<y<2. 


n? 7 m7? _ nt. mn 
ee ae Unm (x,y) = sin = *sin Ty (m,n = 


Answer. Any = 
152, 2). 
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IV. Find Green’s function and the solution of the following problems. 
1. 
y”’ +y= f(x), a<x<b, 
y(a)=0, y(b) =0. 


sin(x—a) sin(—b) 


Answer. G(x, ) = sin(b—a) fora<x <6, 
aay fore <x < b. 
2: 
y"t+y =f), pees 


y(0)=0, y'(2)+y(2) =0. 


Hint. y,(x) = sin x, y2(x) = —sin(x — 2) + cos(x — 2). 


xy" + 4xy’ + 2y = f(x), 1<x <2, 
yd) =0, y(2)=0. 


(x-1 — x7?)(€-! — 2-7) forl <x <&, 
(€-1 — E-2)(x-1 — 2x7?) forE <x <2, 


Answer. G(x, §) = | 


W(x) = fy G(x, HE fd. 


7.11 The Fourier Transform 


This section develops the concept of the Fourier transform, a very important tool for 
both theoretical and applied PDE. Applications are made to physically significant prob- 
lems on infinite domains. 

Recall the complex form of the Fourier series. A function f(x), defined on (—L, L), 
can be represented by the series 


f= Yo caelt*, (7.11.1) 


n=—oo 


with the coefficients 
1 L »nT 
Ch = x | f(Oe't dé, n=0,+1,+42,.... (7.11.2) 

lie ae 

We substitute ((7.11.2) into (7.11.1): 
SL are iM O-8) 
= a i—(x- 
fod= Yap f rede Pag. 7.11.3) 


n=—oo 
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Now assume that the interval (—0o, co) along some axis, which we call the s-axis, is sub- 
divided into pieces, using the subdivision points s,, = = The length of each interval 


. 7 . 
is As = 7: We rewrite ({7.11.3}) as 


oo) L 
fee) = = » [ fen Hd EAs, (7.11.4) 
of 


n=—oo 


so that we can regard f(x) as a Riemann sum ofa certain function of s, over the interval 
(—co, co). Let now L > oo. Then As = 0, and the Riemann sum in (7.11.4) converges 
to 


poy= sf f s@eeDagas. 


This formula is known as the Fourier integral. Our derivation of it is made rigorous in 
more advanced books. Rewrite this integral as 


oe ee ee “Hae ds, ae 
ne el (ZH [16 é\ds (7.11.5) 


We define the Fourier transform by 


_ 1 _ —isé q 
Fo) = | _F@er*as, 


The inverse Fourier transform is then 


f(x)= iSxX F(s) ds. 


1 f 
— e 
V 27 J—co 
As with the Laplace transform, we use capital letters to denote the Fourier transforms. 
We shall also use the operator notation F (f(x)) = F(s). 


1 for |x| <a, 
0 for |x| >a. 
Using Euler’s formula, we compute the Fourier transform: 


Example 7.11.1. Let f(x) = | 


iWog 12 simay 


a ae 2e 
F(s)= —— | e~8§d& = —— —__—__ 
V2 Ja Var sis ah ath 


Assume that f(x) — 0 and f’(x) > 0, as x — +oo. Integrating by parts, 


F (fo) = ce [ fi ®e-dé = = [ fQe-*SdE = isF(s). 


(The boundary term = f(ée7'§| is zero, because |e~'’5| = 1.) It follows that 


F (f" (x) = isF (f' (x) = -s?F(s). (7.11.6) 


These formulas for ¥ (f’(x)) and F (f”(x)) are similar to the corresponding for- 
mulas for the Laplace transform. 
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7.12 Problems on Infinite Domains 
7.12.1 Evaluation of Some Integrals. The following integral occurs often: 


I= [ e* dx =z. (7.12.1) 


We justify this formula as follows: 


and ({7.12.1)) follows. We used polar coordinates to evaluate the double integral. 
We shall show that for any x 


io) gf 
yx) = [ e- cosxzdz = ae (7.12.2) 
0 


Using integration by parts, compute (d denotes the differential) 


y (x)= [ en? (—zsin xz) dz 
0 


io ae 2 
= i, sin xzd (e e) 


x foo} 

2 

= -5 e” cos xzdz, 
) 


which implies that 
, x 

y(x)= — 5). (7.12.3) 
By (712.1) 
y(0) = = (7.12.4) 
Solving the differential equation (7.12.3), together with the initial condition ((7.12.4), 
justifies the formula ({7.12.2). 

The last integral we need is just a Laplace transform (a is a constant) 


co 
- __ vy 
- e*Y cosas ds = rare (7.12.5) 


7.12.2 The Heat Equation for —co < x < ©. We shall solve the initial value 
problem 


Utz = kuxx, -30 <x<o, [¢t>0, 


u(x,0)= f(x),  -00 <x < ©. (7.12.6) 


Here u(x, t) gives the temperature at a point x and time ¢ for an infinite bar. (The bar is 


very long, so that we assume it to be infinite.) The initial temperatures are prescribed 
by the given function f(x), and k > 0 is a given constant. 
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The Fourier transform of the solution 


F (u(x, t)) = u(x, the~* dx = U(s, t) (7.12.7) 


vel. 


depends on s and also on t, which we may regard as a parameter, at the moment. Ob- 
serve that F(u;,(x, t)) = U,(s, t), as follows by differentiating (7.12.7) in t. Applying the 
Fourier transform to the problem (7.12.4) and using (7.11.6), we obtain 


U, = —ks*u, 
U(s,0) = F (u(x, 0)) = F(f(x)) = F(s), 


where F(s) is the Fourier transform of f(x). Integrating this initial value problem for 
U as a function of t (we now regard s as a parameter), 


U(s,t) = F(s)e7*5"#. 
To obtain the solution of ({7.12.6), we apply the inverse Fourier transform and get 


1 © 4 2 1 oF 2 
u(x,t) = =| e!SX F(s)e—ks tds= =| [ eis(x—§)—ks t f(E)déds 
V 270 J—co 21 —co Y—00 


1 - is(x—&)—ks2 


after switching the order of integration. We denote by K the integral in the large paren- 
theses, K = ae els(x—§)—-ks’t de To evaluate K, we use Euler’s formula 


foe} 


K= [ [cos s(x — £) + isin s(x — £)] e“*"t ds = 2 [ cos s(x — Ee“**** ds, 
= j 


because cos s(x — &) is an even function of s and sin s(x — &) is an odd function of s. To 
evaluate the last integral, we make a change of variables s — z, by setting 


Vkts =z, 


and then use the integral in (7.12.2): 


(x—€)? 
2 foe 2 l(’ ok dz= vz 4kt, 
"ali Vkt Vkt 


With K evaluated, we get the solution of (7.12.6): 


(x-8) 


~~ aket “ake f(E)dE. (7.12.8) 


u(x, t) = 


wari 


This oe is important for both PDEs and scabability theory. The function K(x, t) = 


; : — e aK is known as the heat kernel. (Recall from Chapter ff that one may write 


u(x, t) = K(x, t) * f(x), with lim,.9 K(x, t) = 6(x) and limy_,9 u(x, t) = f(x), where « 
denotes the convolution.) 

Assume now that the function f(x), giving the initial temperatures, is positive on 
some small interval (—e, ¢) and zero outside of this interval. Then u(x,t) > 0 for all 
x € (—oo, oo) and t > 0. Not only do the temperatures become positive far from the 
heat source, this happens practically instantaneously! This is known as the infinite 
propagation speed, which points to an imperfection of our model. Observe, however, 
that for this f(x), the temperatures given by are negligible for large |x|. 
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7.12.3 Steady-State Temperatures for the Upper Half-Plane. We shall 
solve the boundary value problem 


Uyx + Uyy = 0, —-w<x<aw, y>QdO, (7.12.9) 
u(x, 0) = f(x), —0 <x<o. — 


Here u(x, y) will provide the steady-state temperature, at a point (x, y) of an infinite 
plate, occupying the upper half of the xy-plane. The given function f(x) prescribes the 
temperatures at the boundary y = 0 of the plate. We are looking for the solution that 
is bounded, as y > oo. (Without this assumption the solution is not unique: if u(x, y) 
is a solution of (7.12.9), then so is u(x, y) + cy, for any constant c.) 

Applying the Fourier transform in x, U(s, y) = z Jue; y)e~'55 dé gives (ob- 
serve that F(uy,(x, t)) = Uj,(s, t)) 


U,—-*U =0, 
(7.12.10) 
U(s, 0) = F(s). 
The general solution of the equation in (7.12.10) is 
U(s, y) = cye" + coe. 


When s > 0, we select c, = 0, so that U (and therefore u) is bounded as y > oo. Then 
c, = F(s), from the initial condition in (7.12.10), giving us 


U(s, y) = F(s)e~*”, whens > 0. 
When s < 0, we select c, = 0, to get a bounded solution. Then c, = F(s), giving us 
U(s, y) = F(s)e*’, whens <0. 
Combining both cases, we conclude that the bounded solution of is 
U(s, y) = F(s)e7#!9, 


It remains to compute the inverse Fourier transform 


u(x,y) = bs-NYF(s)ds = [ F0)( [ dsts-B-1 ds) a 


1 foo) 
— e 
V2a [. 
after switching the order of integration. We evaluate the integral in the large parenthe- 
ses by using Euler’s formula, the facts that cos s(x — €) is even in s and sin s(x — &) is 
odd in s, and (in the last step) the formula (7.12.5): 


[oe] : wo 2y 
else-§)-ISI¥ dg = 2 | e—*Y cos s(x — £) ds = —————. 
/ 0 =f) + 


—o 


The solution of (7.12.9), known as Poisson’s formula, is then 


y [f° f@dé 
Jo. (kee ry 


u(x, y) = 


This integral converges, provided that f(&) does not grow too fast as § > too. 
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7.12.4 Using the Laplace Transform for a Semi-Infinite String. Imagine 
a string extending for 0 < x < oo, which is initially at rest. Its left end point, x = 0, 
undergoes periodic vibrations, with the displacements given by A sin wt, where A and 
w are constants. We wish to find the displacements u(x, t) at any point x > 0 and time 
t > 0, assuming that the displacements are bounded. 

We need to solve the following initial boundary value problem for the wave equa- 
tion, with a given c > 0: 


ig =O thes x>0, 
u(x, 0) = u,(x, 0) = 0, x>0, 
u(0, t) = Asinwt, t>0. 


Take the Laplace transform of the equation in the variable t, denoting U(x,s) = 
£ (u(x, t)). Using the initial and boundary conditions, we get 


eU=CUs, 
a (7.12.11) 
Cis" * 
S? + w? 


The general solution of the equation in ({7.12.11)) is 


£ Ss 
U(x,s) = cee” +o,e ©. 


: A 
To get a solution bounded as x > +00, we select c; = 0. Then c, = — 


condition in (7.12.11), giving 


by the initial 


s2+@2 


x; Aw 
Ue ge 2 — 
G8) Ss? + w? 


Taking the inverse Laplace transform and using the formula (4.2.5) gives the solution 
u(x, t) = Au,)-(t) sin w(t — x/c), 


where u,/-(t) is the Heaviside step function. This formula shows that at any point 
x > 0, the solution is zero for 0 < t < x/c (the time it takes for the signal to travel from 
0 to x). For t > x/c, the motion of the string at x is identical with the motion at x = 0 
but is delayed in time by the value of x/c. 


7.12.5 Problems. 
1—|x| for |x| <1, 


1. Find the Fourier transform of the function f(x) = 
0 for |x| > 1. 


Answer. F(s) = 230 — COS Ss). 


2. Find the Fourier transform of f(x) = e~*!. 


Answer. F(s) = V2 = 
2 


x 
3. Find the Fourier transform of f(x)=e 2. 
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Answer. F(s) =e 2. (Hint. Use the formula ((7.12.2).) 


4. Find the Fourier transform of f(x) = e-9*" where a > 0 is a constant. 


s2 
Answer. F(s) = sea, 


V2a 


5. Solve the heat conduction problem 


Ut — Uxx = 0, —o<x<o, [t>0, 
2 
u(x,0) =e* , —0 <x< oO. 
x2 
Answer. u(x,t) = Le” in 
: > V1+4t , 


6. Show the following for any constant a. 
(i) F(f(x)e"*) = F(s — a). 
(ii) F(f(ax)) = =F) (a #0). 
7. Find a nontrivial solution of the boundary value problem 


Uxx + Uyy = 0, —c0 <x<o, y>QO, 
u(x, 0) = 0, —-0 <x< oO. 


Hint. Assume that u depends only on y. 


This example shows that our physical intuition may fail for unbounded domains. 


8. Use Poisson’s formula to solve 


Uxx + Uyy = 0, —c0o <x<o, y>QO, 
u(x,0) = f(x), -0o<x<o, 


1 for |x| <1, 
0 for |x| > 1. 


where f(x) = | 


1 -1 x41 -1 x-1 
Answer. u(x, y) = — (tan aa ~*), 
us y y 


9. The famous Black-Scholes equation for the price of a stock option is (here V = 
V(S,t)) 
Vit aS*Ks5 + bS%—rV =0, 
where a, b, and r are positive constants. By a change of variables, reduce this equa- 
tion to the heat equation. 
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Hint. If the Y term was not present, we would have Euler’s equation. This suggests 
setting x = Ins. Then let t = —at. We obtain 


; 
Ve= Vex P20, 
where we denoted 2a = b/a — 1. Multiply the last equation by e**, and denote 
w = e**V. We obtain 
W, = Wx — (@ + “) w 
T xx a ? 
2,7 
Finally, multiply this equation by the integrating factor le e og and denote z = 
(a+ “\r 
e’ “a/'w. Conclude that 


Zr = Zxx- 


Elementary Theory of PDE 


This chapter continues the study of the three main equations of mathematical physics: 
wave, heat, and Laplace’s equations. We now deal with the theoretical aspects: propa- 
gation and reflection of waves, maximum principles, harmonic functions, Poisson’s in- 
tegral formulas, variational approach. Classification theory is presented, and it shows 
that the three main equations are representative of all linear second-order equations. 
First-order PDE’s are solved by reducing them to ODE’s along the characteristic lines. 


8.1 Wave Equation: Vibrations of an Infinite 
String 


Waves. The graph of y = (x — 1)? isa translation of the parabola y = x, by one unit 
to the right. The graph of y = (x — t)? is a translation of the same parabola by t units. 
If we think of t as time and draw these translations on the same screen, we get a wave 
of speed one, traveling to the right. Similarly, y = (x — ct)? is a wave of speed c. The 
same reasoning applies for other functions. So that y = f(x — ct) is a wave of speed c 
traveling to the right, while y = f(x + ct) describes a wave of speed c traveling to the left. 


Transverse Vibrations of a Guitar String: d’Alembert’s Formula. Assume that 
an elastic string extends along the x-axis, for —oo < x < oo, and we wish to find its 
transverse displacements u = u(x, t), as a function of the position x and the time t. As 
in Chapter [/, we need to solve the wave equation, together with the initial conditions: 


Uy — C2 


u(x,0) = f(x) for-—co <x <0, (8.1.1) 


Uxx = 0 for —coo <x < cooandt >0, 


u,(x,0) = g(x) for —co < x < oo. 


Here f(x) is given initial displacement, g(x) is given initial velocity, andc > Oisa given 
constant. 

We look for classical solutions, which means that u(x, t) has two continuous deriva- 
tives in x and t (uy, Uy, Uxx, Ux, aNd Uy, are continuous). We perform a change of 
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variables (x, t) > (&, 7), with the new variables (€, 7) given by 
E=x-ct, 
n=x4+ct. 


Compute the partial derivatives: &, = 1,7, = 1, & = —c, andy, = c. We may think of 
solution as u(x, t) = u(&(x, t), n(x, t)). Using the chain rule, we express 


Ux = Ugh, + UyNy = Ug + Uy, 
Ux = (Ux) = (ug + Uy), + (ug + Uy), = Uae + Wey + Ung + Uy = Mee + 2UEy + Uy 
(using that u,)¢ = ue, ). Similarly 
Uy, = Usd; + UN, = —CUg + CUy, 

Upp = —C(—Cuge + CUpe) + ¢(—Cugy + Cuyy) = C7 (Uge — Quy + Upp). 
Substituting these expressions of u,, and u,, into the wave equation and simplifying, 
we get 

UEy = 0. 
Since (ug), = 0, integration in 7 gives 
ug = F(§), 


where F(€) is an arbitrary function. Integrating once more 


un) = [ FEE + Go) =FE) +6. 


Here G(n) is an arbitrary function of 7. The antiderivative of F(€) is an arbitrary func- 
tion, which we again denote by F(&). Returning to the original variables, we have the 
general solution 
u(x, t) = F(x — ct) + G(x + ct). (8.1.2) 
Observe that the wave equation has an overwhelmingly large number of solutions, be- 
cause its general solution depends on two arbitrary functions. 
Turning to the initial conditions, compute 


u,(x, t) = —cF'(x — ct) + cG’(x + ct). 


We have 
u(x, 0) = F(x) + G(x) = f(x), 


u,(x, 0) = —cF’(x) + cG’(x) = g(x). 
Integrating the second equation in gives 


(8.1.3) 


—cF(x) + cG(x) = [ g(t)dt, 
Y 


where y is any constant. Adding to this formula the first equation in (8.1.3), multiplied 
by c, produces 


x 
1 1 
Go) = 5F0)+ 5 feed. 
Y 
From the first equation in 


Fx) = 540) =f a(oar. 
Y 
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Using these expressions in (8.1.2), we get 
x+ct 


x—ct 
u(x, t) = sfx —ct)— ; | g(t)dt + sfx +ct)+ 5a i g(t)dt. 


Writing — ae g(t)dt = a et &(t)dt, we combine both integrals into one: 


u(x,t) = FER + Sete) - aed. 
2 2c Jet 
We derived the famous d‘Alembert formula (published in 1747; see the Wikipedia arti- 
cle). 
In case g(x) = 0, this formula gives 
fixs=h + f(z 4c) 
a 
which is a superposition (sum) of a wave traveling to the right and a wave traveling to 
the left, both of speed c. (The same conclusion is true for general g(x); just look at the 


formula (8.1.2).) 


u(x, t) = 


u 
4 
1 t=0 
wal 
x 
-1 1 
u 
1 
fa t=; 
2 
ee: oak a ee 
ae - 7 
2 2 
u 
t t=1 
ii 
ee to al, 
t t x 
—2 —1 1 2 
u 
4 p=" 
2 
He 
ese oe 
x 
a L 2 7 
2, 2 2 


Snapshots of u(x, t) in case of pinched string. 
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Example 8.1.1 (Pinched String). We solve 


Upp — Uxx = 0 for —co < x < ooandt > 0, 
u(x,0) = f(x) for—c <x <0, (8.1.4) 
u,(x, 0) = 0 for —o < x < w, 


where 
x+1 if-l1<x<0O, 
fO)=41-x if0<x<l, 
0 if |x| > 1. 
The initial displacement f(x) resembles a “pinch” (see the snapshot at t = 0), 
while the initial velocity is zero. By d’Alembert’s formula 


iene sh —t)+ sfx +0). 


This expression implies that the initial “pinch” breaks into two pinches of similar shape, 
but half of the original magnitude, with one of them traveling to the right and the other 
one to the left, both with speed 1. We present the snapshots of u(x, ft) at t = 0 (the initial 
pinch), t = =, t=1l,andt = -. 


(Xo, to) 


xX —ct = Xo — Clo xX+ct = Xo + cto 


The domain of dependence (thick) of the point 
(Xo, to). 


We now define the important concept of characteristic lines. A family of parallel 
straight lines in the (x, t)-plane (with t > 0 and a a constant) 


x-—ct=a 
is called the left characteristic lines, or the left characteristics, for short. They all have 


the slope ox 0, and varying the constant a produces a specific line, parallel to all 


others. Given any point (Xp, to) (with tg > 0), we can select a left characteristic, passing 
through it, namely 


x—ct =Xq — Clo. 
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Let us follow this line for decreasing t until it intersects the x-axis. This happens at 
X = Xq — cto. Similarly, a family of parallel straight lines in the (x, t)-plane, given by 
x +ct = a, is called the right characteristics. They all have the slope -* < 0. The right 
characteristic passing through (Xp, tg) is 


x+ct =X + Clo. 


It intersects the x-axis at x = Xp + cto. The string’s displacement at any point (x9, to) 
is (according to d’Alembert’s formula) 


F(%o = cto) + fo + cto) | 1 fl 
x 


5 7: g(t)dt. 


U(X, to) = 

0—clo 
Geometrically, u(x9, to) is equal to the average of the values of f(x) at the points where 
the characteristics, passing through (x9, yo), intersect the x-axis, plus ~ times the inte- 


gral of g(x) between these points. One calls the interval [xg — ctg, Xo + cto] the domain 
of dependence of the point (Xp, to). 

Given a point (x, 0) on the x-axis, the characteristics passing through it are x+ct = 
Xq and x — ct = X,. The region between these characteristics is called the region of 
influence of the point (x9, 0). If a point (x, t) lies outside of this region, the value of the 
solution u(x, t) is not influenced by the values of f(x) and g(x) at (or near) Xq. 

We say that a function f(x) has compact support if f(x) is identically zero outside 
of some bounded interval [a, b]. In such a case, it is customary to say that f(x) lives on 
[a, b]. 


Lemma 8.1.1. Assume that the initial data f(x) and g(x) are of compact support. Then 
the solution u(x, t) of the problem is of compact support, for any fixed t. 


Proof. If f(x) and g(x) live on [a, b], then u(x, t) lives on [a — ct, b + ct], for any fixed 


t, as follows by d’Alembert’s formula (just draw the regions of influence of (a, 0) and 
of (b, 0). © 


x+ct = Xo x—ct = Xo 


Xo 


The region of influence of the point (x9, 0). 


We define the energy of a string to be 


E(t) = al [u?(x, t) + c2u3(x, t)] dx. 
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Theorem 8.1.1. Assume that the initial data f(x) and g(x) are of compact support. 
Then the energy of a string is constant, for any solution u(x, t) of the wave equation in 


(8.1.1). 
Proof. We shall show that E’(t) = 0 for all t. Indeed, 


[oe] 
E'(t)= ‘| [tpteye + CPU yu, | dx 
—oo 
fo} 
= i [upuyp — C7UxyUy | dx 
—oo 


= [ Uy(Upt — Cig) dx 
=0. 


In the second step we performed integration by parts, with the boundary terms vanish- 
ing by Lemma8.1.1] In the last step we used that u(x, t) satisfies the wave equation. © 


This theorem implies that for all t 
E(t) = E(0) 


7 : [ ; [u2(x, 0) + c2u2(x, 0)| ae 


i a ry) 
5 [ [s?(x) +cf (x)| dx. 
Theorem 8.1.2. The problem has a unique solution. 


Proof. Assume that v(x, t) is another solution of (8.1.1), in addition to the solution 
u(x, t) given by d’Alembert’s formula. Let w(x,t) = u(x,t) — v(x, ft). Then w(x, t) 
satisfies the wave equation (8.1.1) with zero initial data (w(x,0) = w;(x,0) = 0). By 
G13) . 

E(t) = ‘| [w?(x, t) + c?w2(x, t)] dx = E(0) = 0, 


for all t. It follows that w,(x, t) = 0 and w,(x,t) = 0 for all x and t, so that w(x, t) = 
constant. Setting t = 0, we see that this constant is zero. We conclude that w(x, t) = 0 
for all x and t, which means that v(x, t) is identical to u(x, t). © 


8.2 Semi-Infinite String: Reflection of Waves 


Suppose that a string extends along the positive x-axis, for 0 < x < oo, and we assume 
that its left end point is kept in a fixed position, so that its displacement is zero at x = 0, 
for all t, u(0, t) = 0 (the Dirichlet boundary condition). To find the displacements u(x, t), 
we need to solve the wave equation, together with initial and boundary conditions: 


Upp — C2Uzx = 0 for0 <x < co andt>0, 
u(x,0) = f(x) for0<x<o, (8.2.1) 
u,(x,0) = g(x) for0<x<.o, -_ 


u(0, t) = 0 for t > 0, 
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with given initial displacement f(x) and initial velocity g(x). 
Recall the concept of the odd extension. If f(x) is defined on (0, co), then its odd 
extension 
f@) for x > 0, 
—f(-—x) forx <0 


is defined for all x 4 0. Geometrically, this amounts to reflecting the graph of f(x) with 
respect to the origin. (f(x) is left undefined at x = 0.) The resulting function f,(x) is 
odd, satisfying f,(—x) = —f,(x) for all x 4 0. If f(0) is defined, then f,(0) = f(0). 

If f(x) and g(x) are the odd extensions of the functions f(x) and g(x), respec- 
tively, then we claim that the solution of the problem is 


x+ct 
ea i go(t)dr. 


Jo(x) = | 


u(x, t) = (8.2.2) 


Indeed, we already know that this formula gives a solution of the wave equation and 
that u(x, 0) = fo(x) = f(x) and u,(x, 0) = g,(x) = g(x), for x > 0. As for the boundary 
condition, we have 


ct 
u(0,t) = foe) Sole) + al g(t)dt = 0. 
—ct 


Example 8.2.1. Solve 
Upp —Uxx =O for0<x< oandt> 0, 
u(x,0)=x for0<x<o, 
u,(x,0) =x? for0<x <0, 
u(0,t)=0 fort >0. 
We have (here c = 1) 


xt+t 
—t t 
u(x, t) = LST D4 fet) + ; / £o(t)dt, (8.2.3) 
x-t 
2 fi > 0, 
with f,(x) = x and g,(x) = ‘i sia 
—x’ forx <0. 


Case 1. t < x. Then x —t > 0, and 


x+t 
x-t+x+t 1 1 
u(x,t) = lee i Pdr=x+x*t+ <0. 
2 ie 3 


Case 2. t > x. Then x —t < 0, and the integral term in needs to be split into two 
pieces: 


0 x+t 
—t t 1 1 1 
u(x,t) = cide el ee dt+= dt =x+xt? + =x}. 
2 Ze. 2 J, 3 


1 
x+x2t+-03 fort <x, 
Answer. u(x,t) = 
xX+xt7 + 3x fort > x. 
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We now return to the formula (8.2.2). If x — ct > 0, then we can replace f,(x) and 
8 (x) by f(x) and g(x), respectively. In case x — ct < 0, we claim that the formula 


G22) gives 


x+ct 
Gr= Seer rier n 5 [ a(r)dr. (8.2.4) 
—x+ct 


—x+ct 


Indeed, observe that —x + ct = —(x—ct) >Oand f.., go(t)dt = 0. Then 


x+ct 


x+ct —x+ct x+ct 
[ soar=f settee fgo(nar= fan. 
x—ct x—ct —x+ct —x+ct 


In case g(x) = 0, it follows from that 

—~f(EXo + cto) + Fo + cto) 
5) , 

so that instead of computing f(x) at x9 — ctp, we compute f(x) at the point symmetric 

with respect to x = 0. We say that the left characteristic got reflected when it hit the 

t-axis, and the opposite sign is the way to account (or the “price to pay”) for a reflected 

wave. 


U(X, to) = (8.2.5) 


(Xo; to) 


- 
/ 


Xo — Clo —Xo + Clo Xo + Clo 


Reflection at the boundary point x = 0. 


Example 8.2.2 (Pinched string). We solve 


Upp — Uxx, = 0 for0 <x < candt>0, 
u(x,0) = f(x) for0<x<0o, 
u,(x, 0) = 0 for0<x<o, 


u(0, t) = 0 for t > 0, 
where 
x-1 ifl<x <2, 
f@)=7-x+3 if2<x <3, (8.2.6) 
0 for all other x. 
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(This is the pinch considered earlier, shifted two units to the right and centered at x = 
2.) Using the odd extension f,(x), we write the solution of this problem on (—oo, oo): 


Jo(x = t) + fox +0) 


u(x,t) = 5 


(8.2.7) 


On the interval (—co, oo), the graph of f,(x) includes the original positive pinch on the 
interval (1,3) and a negative pinch of the same shape over (—3, —1) (f(x) is zero for 
other x). By (8.2.7), each pinch breaks into two half-pinches, and the four half-pinches 
are set in motion, as above. We then translate our results to the original (physical) 
interval (0, oo). 

Conclusion: the original “pinch” f(x) breaks into two pinches of similar shape, 
but half of the magnitude, with one of them traveling to the right and the other one 
moving to the left, both with speed 1. At the time t = 1, the left half-pinch reaches the 
x = Oend point. By the time t = 3, it completely reflects and becomes negative, of the 
same triangle shape. Then both half-pinches (one of them is positive, and the other 
one negative) travel to the right, for all t > 3. 
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Snapshots of a semi-infinite pinched string. 
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8.3 Bounded String: Multiple Reflections 


Assume that the string is finite, extending over some interval 0 < x < L, and at both 
end points the displacement is zero for all time. We need to solve 


Ur — Cty, = 0 for0 < x <Landt>0, 
u(x, 0) = f(x) for0<x<L, (8.3.1) 
u,(x, 0) = g(x) for0<x<lL, - 


u(0,t) =u(L,t)=0 fort >0, 


with given initial displacement f(x) and the initial velocity g(x). 

Let f,(x) be the odd extension of f(x) from (0, L) to (—L, L), and then we extend 
fo(x) to (—co, oo) as a function of period 2L. We call this new extended function f(x). 
Similarly, we define the extension g(x) of g(x). On the original interval (0, L) these 
extensions agree with f(x) and g(x), respectively. Clearly, f(x) and g(x) are odd on 
(—oo, co). In addition, both of these functions are odd with respect to L, which means 
that 


f(L+x)=—-f(L—x) and g(L+x)=-g(L—x), forall x. 
It turns out that the solution of (8.3.1) is 


= = x+ct 
uei= fens tere + x [ a(r)dz. (8.3.2) 
x-ct 


Indeed, comparing with d’Alembert’s formula, we see that this function satisfies the 
wave equation and the initial conditions. Turning to the boundary conditions, we have 


zn ra ct 
wo,t) = Foes Fed) 2 


al &(t)dt = 0, 
—ct 


because f(x) and a(x) are odd. At the other end point 


fG=afeew 1 ff" 
a, + a [. &(t)dt = 0, 


because f(x) and a(x) are odd with respect to L. 
Consider now the case g(x) = 0. Then 


f(x —et) + f(x+ct) 
——— 


u(L, t) = 


u(x, t) = (8.3.3) 
Similarly to the above, we reflect the characteristics when they reach either the t-axis 
or the line x = L. This time, when we continue the characteristics backward in time, 
multiple reflections are possible, from both the t-axis (the line x = 0) and from the line 
x = L, before the x-axis is reached. By examining the graph of f(x), one can see that 
the formula (8.3.3) implies that the result (or the “price”) of each reflection is change 
of sign. So, if after three reflections the left characteristic arrives at a point A inside 
(0, L), then its contribution is f(x — ct) = —f(A). If it took ten reflections for the right 
characteristic to arrive at a point B € (0, L), then we have f(x + ct) = f(B). 
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Example 8.3.1. Find u(1/4, 1), u(1/4, 2), and u(1/4, 3) for the problem 


Upp — Uxx = 0 for0<x<2andt>0, 
u(x,0) = f(x)=x? for0<x <2, 
u,(x, 0) = 0 for0 < x < 2, 


u(0,t) = u(2,t)=0 fort> 0. 


Here c = 1, so that the left characteristics have slope 1 and the right ones have slope —1. 
When finding the solution at (1/4, 1), the left characteristic is reflected once, coming 
down at x = 3/4, while the right one is not reflected, coming down at x = 5/4, giving 


u(1/4,1) = —5 (3/4) + 5 (5/4) = 5. 


To find the solution at (1/4,2), both characteristics are reflected once, and both are 
coming down at the same point x = 7/4, giving 


u(1/4,2) = ~5.f(7/4) — 5 fC7/4) = -Z2. 


When computing u(1/4, 3), the left characteristic is reflected twice, coming down at 
x = 5/4. The right characteristic is reflected once, coming down at x = 3/4, giving 


u(1/4,3) = 4405/4) - 4 f03/4) = 3 


Example 8.3.2 (Pinched string). We solve 


Upp — Ux, = 0 for0O<x<8andt>0, 
u(x, 0) = f(x) for0<x <8, 
u(x, 0) = 0 for0<x <8, 


u(0,t) = u(8,t)=0 fort > 0, 


with the initial displacement 


x-3 if3 <x <4, 
ft) =4-x+5 if4<x<5, 
0 for all other x € [0, 8]. 


The same pinch we considered above is now centered at x = 4 (see the snapshot 
at t = Oin the picture). Reasoning as in the case of a semi-infinite string, the formula 
implies that the initial “pinch” breaks into two pinches of similar shape, but 
half of the magnitude, with one of them traveling to the right and the other one to the 
left, both with speed 1. When the left half-pinch reaches the x = 0 end point, at the 
time t = 3, it gradually reflects and at t = 5 becomes negative, of the same shape. 
When the right half-pinch reaches the x = 8 end point, at the same time t = 3, it 
also reflects and becomes negative, of the same shape. Then both half-pinches travel 
toward each other, turning at t = 8 into the exact negative of the original pinch. Then 
the negative pinch splits up into two halves, traveling to the left and to the right and 
becoming positive after the next round of reflections. Then both half-pinches travel 
toward each other, turning at t = 16 into exactly the original pinch. Then everything is 
repeated. The result is periodic in time motion (of the period 16), consistent with the 
formulas obtained previously by separation of variables. 
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Snapshots of a bounded pinched string. 


8.4 Neumann Boundary Conditions 


We consider again a semi-infinite string, 0 < x < oo. Assume that at the x = 0 end 
point, the string is allowed to slide freely up and down, but it is attached to a clamp, 
which makes its slope zero, so that the condition (0, t) = 0 is prescribed at the bound- 
ary point x = 0, which is referred to as the Neumann boundary condition. We are led 


to solve the problem 


Urge = Cts _ 0 


u(x, 0) = f(x) 
u,(x,0) = g(x) 
u,(0,t) =0 


for0 <x < wandt> 0, 
for0<x<o, 

(8.4.1) 
for0<x<o, 


fort > 0, 


with given initial displacement f(x) and the initial velocity g(x). 
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Define f(x), the even extension of f(x), by 


f(x)  forx>0, 


Fela) = pa for x < 0. 


The function f,(x) is even, defined for all x 4 0. The graph of f,(x) can be obtained by 
reflecting the graph of f(x) with respect to the y-axis. (f,(x) is left undefined at x = 0. 
If f(0) is defined, then f£,(0) = f(0).) Similarly, define g(x) to be the even extension 
of g(x). We claim that the solution of is given by 


feet) + f(x +et) 1 [os (ar. 
—ct 


i 2 2c J. 


Indeed, we know (comparing with d’Alembert’s solution) that this formula gives a solu- 
tion of the wave equation and that u(x,0) = f(x) = f(x) and u;(x, 0) = g(x) = g(x), 
for x > 0. Turning to the boundary condition, compute 

fe(x—cth+ fi(x+ect) 1 


(26 1) = : + = [gelx + ct) — gol et)], 


and therefore 


w= BOO + KC) 


1 
a Oya [ge(ct) = &e(—ct)] = 0, 
using that the derivative of an even function is an odd function. 


Example 8.4.1. Solve 


Uryp —4Uxx =O for0<x< candt>0, 
u(x,0)=x? for0<x <0, 
u,(x,0)=x for0<x<o, 
u,(0,t)=0 fort>O0. 


We have (x), = x? and (x), = |x|. The solution is 

2 2 x+2t 
—2t 2t 1 
(= 2H) + + 21) + if \c|dr. 
4 x—2t 


u(x, t) = 5 


Considering two cases, depending on the sign of x — 2t, we calculate 


x? 4+4t74+xt forx—2t>0, 
ax? + 50? for x — 2t <0. 


u(x,t) = | 


In case g(x) = 0, the solution of (8.4.1) is 


f(x—ct)+f(x+ct) fore Sot 
u(x,t) = 7 


2 
f(—x+ct)+f(x+ct) 
2 


for x < ct. 


If a wave is reflected, we evaluate f(x) at the point where the reflected wave comes 
down on the x-axis (and do not change the sign). 
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Only a small adjustment is required for bounded strings: 


Uy — C7Uxx = 0 for0 <x <Landt>0, 
u(x, 0) = f(x) for0<x<L, (8.4.2) 
u,(x,0) = g(x) for0 <x <L, me 


ux(0,t) = u,(L,t)=0 fort >0. 


Let f.(x) be the even extension of f(x) from (0, L) to (—L, L), and then we extend f,(x) to 
(—co, oo) as a function of period 2L. We call this new extended function f(x). Similarly, 
we define the extension §(x) of g(x). On the original interval (0, L) these extensions 
agree with f(x) and g(x), respectively. Clearly, f(x) and 8(x) are even functions on 
(—oo, co). In addition, both of these functions are even with respect to L, which means 
that 

f@+xy=f(-x and &L+x)=8L—-»), forall x. 
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Semi-infinite pinched string with the Neumann 
condition. 


It is straightforward to verify that the solution of (8.4.2) is given by 


rv a x+ct 
t= fens sere i = [ a(c)ar. (8.4.3) 
x-ct 


It is now a simple exercise to draw pictures for a pinched string, for both semi-infinite 
and bounded strings (at end points, the reflected half-pinch keeps the same sign). 
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Example 8.4.2 (Pinched string). We solve 


Upp — Ux, = 0 for0 <x < co andt>0, 
u(x,0) = f(x) for0<x<o, 
u,(x, 0) = 0 for0<x<o, 


u,(0, t) = 0 fort > 0, 
where f(x) is the familiar pinch, centered at x = 2: 


x-1 ifl<x <2, 
f@=4-x+3 if2<x <3, 
0 for all other x. 


Using the formula (here §(x) = 0), we conclude that the original “pinch” f(x) 
breaks into two pinches of similar shape, but half of the magnitude, with one of them 
traveling to the right and the other one moving to the left, both with speed 1. At the time 
t = 1, the left half-pinch reaches the x = 0 end point. By the time t = 3, it completely 
bounces off the left end point and stays positive, of the same triangle shape. Then both 
positive half-pinches travel to the right, for all t > 3. 


8.5 Nonhomogeneous Wave Equation 


Let us recall Green’s formula from calculus. If a closed curve C encloses a region D in 
the xt-plane, then for continuously differentiable functions P(x, t) and Q(x, t) we have 


i P(x, t)dx + Q(x, t) dt = | [Q,.(x, t) — B(x, t)] dx dt. 
c D 


We now consider nonhomogeneous equations 
Uy — CUy, = F(x,t) for —co <x < oandt> 0, 
u(x,0)= f(x)  for—co <x < o, (8.5.1) 
u(x, 0) = g(x) for —co < x < oo. 


Here F(x, t) is given the acceleration of the external force acting on the string, as was 
explained in Chapter [J The initial displacement f(x) and the initial velocity g(x) are 
also given. 

For any point (Xo, tg), we denote by A the characteristic triangle, formed by the 
characteristic lines passing through (%9,t 9) and the x-axis, with the vertices at 
(Xq — cto, 0), (Xp + Clo, 0), and (Xo, to). By P we denote the boundary curve of A. Using 
Green’s formula and our equation, 


fu dx +c’u, dt =— | (upp — C?Uxx) dxdt = — [fo t)dx dt. (8.5.2) 
is D A 


We now calculate the line integral on the left, by breaking the boundary I into 
three pieces, [,, 5, and I, which are the line segments joining the vertices of A. The 
integral over [ is the sum of the integrals over I), Ih, and I3. Along Ii, we have t = 0 
and dt = 0. Then 


Xo+cto 
[ u, dx + c*u, dt = [ u;(x,0) dx = i g(t)dt. 


Ty Ty x—Cto 
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(Xo, to) 


re 1) 


Xo Cto q Xo + Cto 


The characteristic triangle A. 


The equation of I, isx+ct = X9 +ctp, and so dx +cdt = 0. We replace dx = —cdt and 
dt = — dx, obtaining 
c 


[wax teuat =e [ ude +u,dt =e f du 
r, Tr, 2 


= —c[u(X9, to) — U(Xo + Ct, 0)] = —c[u(Xo, fo) — f(xo + to)]- 
The equation of I; is x — ct = x9 — ctg, and so dx — cdt = 0. We replace dx = cdt and 
dt = ; dx, obtaining 


[ waxteucat=e nds tudt=e [ du = c[f (Xp — cto) — u(Xo, to)] . 


T'3 Ts T's 
Using these three integrals in (8.5.2), we express 
Xo+cto 
— ct t 1 1 
u(Xo; to) = fo = Clo) + fo + clo) + — g(t) dt+ — F(x, t) ax at. 
2 2c J. 2c JI, 


‘0 —Cto 
Finally, we replace (x9,to) — (x,t) and in the double integral rename the dummy 
variables (x, t) > (&, 7), obtaining the solution 


fxret)+ fete) 1 [- atode 
—ct 


2 2c J. 
1 
+x [[ FG naga 


This formula reduces to d’Alembert’s formula in case F(x,t) = 0. Observe also 
that the characteristic triangle A depends on x and t. 


u(x,t) = 
(8.5.3) 


Example 8.5.1. Solve 
Upp —9Uxx =X for—co<x< coandt>0O, 
u(x,0)=0 for—co<x< oo, 


2 


u,(x,0) =x* for—co<x<o. 
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By (@.5.3), , 
Xo+3to 
1 1 
iW kecty) = z/ dtt+ z [fe dt. 
Xo—3to A 


The first integral is equal to = [(xo + 3t9)? — (Xo — 3t)?] = x$to + 3t3. The double 
integral is evaluated as follows: 


to —3t+Xxo+3to 
[[xexace [ (/ sds) dt 
A 0 3t+X9—3to 


to 
1 
: [ [(-3t + x0 + 3f)” — (3 + Xo — 3fo) | de 
0 


1 3 fo 1 3 fo 2 
Ts (—3t + Xp + 3to) , ae (3t + Xp — 3tg) , = 3X6, 
so that u(Xo, to) = x2to + 38 + =Xold- Replacing (x9, tg) > (x, t), we conclude 
u(x,t) = x*t + 303 + xt. 


Duhamel’s Principle. Consider the problem 
Uy — C7Uyx = F(x,t) for —co <x < oandt>0, 
u(x, 0) = 0 for —co < x < ov, (8.5.4) 
u,(x,0) = 0 for —co < x < oo, 


with homogeneous (zero) initial conditions. Its solution at a point (Xp, to), written as a 
repeated integral, is 


U(Xq, to) = = ff re. t) dx dt 
A 
1 to —ct+XgtCcto 
=— (/ F(x, t) ts dt 
2c 10) ct+Xo—Ccto 


to 1 —CN+Xo+Ccto 
=| (=f Fessnax) dn. 
0 2c cCN+Xq—Cto 


In the last step we changed the “dummy” variable ¢ to 7. We now consider a family of 
problems, depending on a parameter 7: find U(x, t) solving 
Uy, — C2U;,, = 0 for —co < x < coandt> 7, 
U(x,n) =0 for —co < x < ©, (8.5.5) 
U,(x,n) = F(x,n) for —co < x < ©. 
Here the initial conditions are prescribed at the moment tf = yn, and the force term 


F(x, t) now acts as the initial velocity. The solution U depends also on the parameter 
n, so that U = U(x,t,n). By adjusting d’Alembert’s formula (the initial time is now 
t = n), the solution of at a point (Xp, to) is 

—CN+X9+Ccto 


1 
U(X, to.) = al F(x,n) dx. 


cCN+Xq—Cto 
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(The left and the right characteristics are continued backward from the point (Xp, to) 
until they intersect the line t = 7.) The solution of the original problem is then 


to 
iGnty= i U(Xo. tor nddn. 
0 


We see that the force term F(x, t) is being distributed as the initial velocities at times 
n (0 < n < fg), and at the time fy we integrate (sum up) the effects of these initial 
velocities. 

A similar approach works for many other evolution equations, which are equations 
involving the “time” variable. 


8.5.1 Problems. 


1. Solve the initial value problem, and describe its physical significance. Here u = 
u(x, t). Simplify your answer. 


Upp — 4Uxx = 0, -w<x<o, (20, 
u(x, 0) = x, -0 <x<o, 
u,(x,0) =cosx, -—0o <x<oo. 


Answer. u(x,t) =x + - cos x sin 2t. 


2. Find the values of the solution u(3, 1) and u(1, 3) for the following problem: 
Uy —Uy,y =0, O<x<w, t20, 
u(x,0)=x?, 0<x<o, 
u,(x,0)=x, O<x<o, 
u(0,t)=0, t>0. 


Answer. u(3,1) = 13; u(1, 3) = 9. 


3. Solve the initial boundary value problem, and describe its physical significance. 


Up — 4Uxx = 0, 0<x<mw, (20, 
u(x, 0) = x, 0<x<o, 
u,(x,0) =cosx, 0<x< oo, 
u,(0, t) = 0, t>0. 
-2 2 : 
Answer. u(x,t) = eld balsas a i + ~ cos xin 2t. 


4. Solve the nonhomogeneous boundary value problem, and describe its physical sig- 
nificance. Simplify your answer. 


Upp — 4Uyx =X, —-—O<xX<w, (20, 
u(x,0)=0, -w<x<0oo, 


u,(x,0)=0, -—ao<x<oo. 
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Answer. u(x,t) = xt. 


5. Solve the nonhomogeneous boundary value problem. 


Uy — 4Uy,x =X+3t, -—wo<x<w, (20, 
u(x, 0) = 0, —-w<x< a, 
u,(x, 0) = cos x, —-w<x<ow. 


Answer. u(x,t) = - (xt? + t3 + cosx sin 2t). 


6. Solve the initial boundary value problem, and describe its physical significance. 
Ute — 4Uxx = 0, 0<x<w, (20, 
u(x, 0) = x, 0<x<om, 
u,(x,0) =sinx, 0<x< oo, 
u(0, t) = 0, t>0. 


ia : 
Answer. u(x,t) =x+ 5 Sin x sin 2t. 


7. Solve the initial boundary value problem, and describe its physical significance. 
Upp — 4Uxx = 0, 0<x<w, (20, 
u(x, 0) = x?, 0<x< 0, 
u,(x,0) =cosx, 0<x< oo, 


u(0, t) = 0, £20; 


8. Find u(3, 1) and u(1, 3) for the solution of the following problem: 


Upp — 4Uyx = 0, 0<x<w, (20, 
u(x,0)=x+1, 0<x<o, 
u,(x,0) = 0, 0<x<om, 
u(0, t) = 0. 


Answer. u(3,1) = 4, and u(1, 3) = 1. 


9. Solve 
Ut =Uxx, O<x<aw, t>O0, 
u(x, 0) = x?, 
U;,(x, 0) = x, 
u(0, t) = 0. 


2 2 
x°+xt+t* fort <x, 

Answer. u(x,t) = 
3xt fort > x. 
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10. Find u(3, 1) and u(1, 3) for the solution of the following problem: 


Upp — 4Uyx = 0, 0<x<w, [(20, 
u(x,0)=x+1, 0<x<a, 
u,(x,0) = 0, 0<x<om, 
u,(0,t) = 0. 


Answer. u(3, 1) = 4, and u(1, 3) = 7. 


11. Find u(1/2, 2) and u(1/3, 3) for the following problem: 


Upp — Uxx = 0, 0<x<2, t20, 
u(x, 0) = x, 0<x <2, 
u,(x,0) = 0, 0<x <2, 


u(0,t) =u(2,t)=0, t>0. 


1 


Answer. u(1/2,2) = -*, and u(1/3, 3) = : 


12. Find u(1/2, 2) and u(1/3, 3) for the following problem: 


Upp — Uxy = 0, 0<x<2, [t20, 
u(x, 0) = x, 0<x <2, 
u,(x, 0) = 0, 0<x <2, 


u,(0,t) = u,(2,t)=0, t>0. 
Answer. u(1/2,2) = -, and u(1/3, 3) = 1. 


13. Consider a wave equation with a lower-order term (a > 0 is a constant) 
Upp — 4Uyx, t+au,;=0, -o<x<ow, (20. 


Assume that the solution u(x, t) is of compact support. Show that the energy E(t) = 
; SJ”, (uz + 4u2) dx is a decreasing function. 


14. (Equipartition of energy) For the initial value problem 
Upp — C7Uxy = 0 for —co <x < oandt>0, 
u(x,0) = f(x), u,(x,0) = g(x), for —co < x < oo 
assume that f(x) and g(x) are of compact support. Define the kinetic energy k(t) = 
- SJ’, uz(x, t) dx and the potential energy p(t) = - Sf, uz (x, t) dx (so that E(t) = 
k(t) + p(t) is the total energy, considered before). Show that 
k(t) = p(t), _ for large enough time f. 


Hint. From d’Alembert’s formula 
f'(x—ct)+ fi'(x+ct)  g(x+ct)-— g(x -ct) 
= SH 
2 2c 
—cf'(x —ct)+cf'(x + ct) ‘ g(x + ct) + g(x — ct) 


a 2 2 
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15. 


16. 


17. 


18. 


Then 
up — Pu = (ut, — ctty) (tt + Cty) 
= (g(x —ct) —cf'(x —ct)) (cf'(x + ct) + g(x +. ct)) = 0, 
for large t, because both x —ct and x + ct will leave the intervals on which f(x) and 
g(x) live. 
Let u(x, t) be a solution of the heat equation 
Uz = SUxx, 0<x<1,t>0, 


u(0, t) = u(1, t) = 0. 


Show that E(t) = Sy u*(x, t) dx is a decreasing function. 


Show that u(x, t) = 0 is the only solution of the nonlinear equation 
Uy = 5Uy, —U +uu,, O<x<1,t>0, 
u(0, t) = u(1, t) = 0, t>0, 
u(x, 0) = 0, 0<x<l. 


1 


Hint. Show that E(t) = f u(x, t) dx is a decreasing function. 


Think of some function. Then write down two solutions of the wave equation 
Upp — QUyx = O 


connected to that function. 


Hint. I thought of f(z) = —*_ and obtained two solutions, u,(x,t) = ese 
sin 5z sin 5(x—3t) 
X+3t 
and Uy(x, t) = sin 5(x+31)" 


Let u(x,t) be a complex-valued solution of a nonlinear Schrédinger’s equation 
G=V-1 
iv; + Vyx + 2v|v|* = 0, 


where |v| denotes the complex modulus of u(x, t). Find the standing wave solution 
in the form v(x, t) = e!”"u(x), with a real-valued u(x) and a constant m > 0. 


Hint. Recall that u(x) = eS are homoclinic solutions of 
COS. mM x-Cc 
u" —mu+t 2u3 =0. 
ym 


cosh m(x-c) 
Schrédinger’s equation are also possible.) 


Answer, u(x,t) = elm , with arbitrary constant c. (Other solutions of 
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8.6 First-Order Linear Equations 
Recall that curves in the xy-plane can be described by parametric equations x = x(s) 
and y = y(s), where s is a parameter, a < s < b. Along such a curve, any function 
u = u(x, y) becomes a function of s, u = u(x(s), y(s)), and by the chain rule 

d ul x 

ag UOCS), MOS) = Ux ((), (S))x"(8) + UWS), W(S))Y"G)- 

We wish to find u = u(x, y), solving the first-order equation 
a(x, y)Ux + D(x, y)uy + c(x, yu = f(x,y), (8.6.1) 


where continuously differentiable functions a(x, y) and b(x, y) and continuous func- 
tions c(x, y) and f(x, y) are given. 
Consider a system of two ODE’s 


dx 

= ay) 

dy (8.6.2) 
‘ds = b(x, y)s 


depending on some parameter s, with the initial conditions 
x(0) = Xo, (0) = yo. (8.6.3) 


By the existence and uniqueness theorem, Theorem 6.1.1], there exists a unique solution 
(at least locally near the initial point (xo, yo)) x = x(s) and y = y(s), which defines a 
curve, called the characteristic curve, or the characteristic, for short, so that we can find 
a characteristic, passing through any point (x9, yo). Along the characteristic curve, our 


equation becomes 


a + c(x(s), y(s)u = f(x(s), y(s)). 


The original PDE becomes an ODE along the characteristic curve! 
One often chooses either x or y as the parameter on characteristics. Observe that 
from 
dy _ dy/ds _ b(x,y) 
dx dx/ds~ a(x,y)’ 


If x is chosen as the parameter on the characteristics, then y = y(x), and 
b(x, y) 
Ya(x,y)’ 
Dividing by a(x, y), we rewrite it as (we assume that a(x, y) # 0) 
du, sy) _ fy) 


dx a(x,y) a(x, y) 
Then we solve this ODE along the characteristics, beginning at a point where u(x, y) is 
prescribed. (Here y = y(x), and we solve for u = u(x).) 
If y is chosen as the parameter, then x = x(y), and by 


(8.6.4) 


d _ dy _ 
qu ly) = Uy fy. =u,+u 


d dx a(x, y) 
—u(x,y) = uy + uy = uy, + uy. 
dy ( y) * dy y * b(x, y) y 
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Dividing (8.6.1) by b(x, y), we rewrite it as (assuming that b(x, y) # 0) 


du | cay) _ fy) 
dy b(x,y) ——b(x, y)’ 


giving an ODE for u = u(y). 


Example 8.6.1. Find u = u(x, y), solving 
ux + Uy = 1, 
u(x, 0) = e*. 


Here the solution (or the “data”) is prescribed along the x-axis. By (8.6.4), the equation 
to find the characteristics is 


(8.6.5) 


dy _ 

dx 
The characteristics are the straight lines y = x +c. The one passing through a point 
(Xo, Yo) is 


1. 


Y=X+Vo—Xo- 


(Xo, Yo) 


Xo — Yo 


Integrating along the characteristic line. 


It intersects the x-axis at x = Xp — Yo. Choosing x as the parameter, the equation 


in (8.6.5)) becomes 
du _ 1 


a 
We integrate this equation along the characteristic line, between the points (xg — yo, 0) 
and (Xo, yo), or between the parameter values of x = X9 — Yo (where y = 0) and x = Xp 


(where y = yo): 


u(Xo, Yo) — U(Xo — Yo, 0) = yo, 
U(Xo, Yo) = U(X — Yo. 0) + Yo = e*9~ + Yo. 
(The data in the second line of was used in the last step.) Finally, replace the 
arbitrary point (Xo, Vo) by (x, y). 


Answer. u(x, y) =e*9 + y. 
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Yo - sin Xo (Xo,Yo) 


Figure 8.1. A characteristic line for the equation 


(8.6.6). 


Example 8.6.2. Find u = u(x, y), solving 


Uy + COS XUy = sin x, 


u(0O, y) = siny. 


This time the data is given along the y-axis. The characteristics are solutions of 


(8.6.6) 


dy 
Pi COS X, 


which are y = sinx +c. The one passing through the point (Xp, yo) is (see Figure 
y = sin xX + yo — Sin Xp. 

It intersects the y-axis at y = yo — sinX 9. Choosing x as the parameter, the original 

equation becomes (along the characteristics) 


du . 
—  =sinx. 
dx 


We integrate along the characteristic curve, between the point (0, yy — sin X)) on 
the y-axis, where the data is given, and the target point (9, yo): 


Xo Xo 
[ di dx = i sin x dx, 
o «ax 0 


U(X, Yo) — UO, Vo — SiN Xp) = —COSXg + 1, 


U(X, Yo) = UCO, Yo — SiN Xp) — COS Xqg + 1 = Sin (Yo — Sin Xp) — cos Xq +1. 
Answer. u(x, y) = sin(y — sinx) —cosx +1. 


Example 8.6.3. Find u = u(x, y), solving (here f(x) is a given function) 
sin yu, + Uy = e”, 
u(x, 0) = f(x). 


The data f(x) is given along the x-axis. The characteristics are solutions of 


(8.6.7) 


Ye 
dy Ms 
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y 


(Xo,Yo) 


- 1+X9+COS Yo 


xX 
Figure 8.2. A characteristic line for the equation 
(8.6.7). 
which are x = —cosy +c. The one passing through the point (Xp, yo) is 
X =—COSY+ Xp + COS Yo. (8.6.8) 
It intersects the x-axis at x = —1+Xg + COS yo. We shall use y as the parameter. (One 


cannot use x as the parameter, because solving for y = y(x) produces multiple 
answers.) The original equation becomes (along the characteristics) 


oy 
dy 
We integrate along the characteristic curve, between the points (—1+ xg +C0S yo, 0) 


and (XQ, Yo), or between the parameter values of y = 0 (where x = —1 + Xp + COS yo) 
and y = yo (where x = Xp): 


U(Xo, Yo) — U(—1 + Xo + COS Yo, 0) = e% — 1, 
u(X9, Yo) = U(—1 + Xp + COS Yo, 0) + e% —1= f(—1+Xp + cosyy) +e% — 1. 


Answer. u(x, y) = f(-1+x+ cosy) +e” —1. (This expression may also be seen as the 
general solution of our equation, considering the function f(x) to be arbitrary.) 
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Example 8.6.4. Find u = u(x, y), solving 


XUx — Wuy +U=X, 


(8.6.9) 
u=1 ony=x. 
The data is given along the line y = x. The characteristics are the solutions of 
ay 
dx x’ 
which are the hyperbolas y = <. The one passing through the point (Xp, yo) is 
—_ XoYo 
ae (8.6.10) 


Let us begin by assuming that the point (Xo, yo) lies in the first quadrant of the xy- 
plane, so that x) > O and yy > 0. The characteristic (8.6.10) intersects the line y = x at 
the point (./X0¥o: /XoYo)- Taking x as the parameter, our PDE becomes (after dividing 
by x) 


or 


We integrate along the characteristic curve, between the points (\/Xo¥o> /Xo¥o) and 


(Xo, Yo), Or between x = 4/Xg Yo (where y = 4/Xpyo) and xX = Xo (where y = yo), 
obtaining 


Xo d Xo 
i Fe (xu) dx = [ x dx, 
Vxov0 °* V%0¥o 
1 1 
XpU(Xo, Yo) — V XoYoUly XoYos V XoYo) = 5%0 a 7*0Yo- 


(It does not matter which of the limits of integration is larger, ./x9¥o or Xo.) By the 
initial condition, u(,/X Vo, +/XpYo) = 1, and then 


1 1 
U(X, Yo) = 4/ . + 3%0 — 390: 


In case the point (Xo, yo) lies in the third quadrant, we obtain the same result. In case 
the point (Xp, yo) lies in either the second or the fourth quadrants, our method does not 
apply, because the characteristic hyperbolas do not intersect the line y = x. 


Answer. u(x, y) = vz + =x — “y; in case the point (x, y) lies in either the first or the 


third quadrants, and no solution exists if the point (x, y) lies in either the second or the 
fourth quadrants. 


We conclude by observing that the curve, on which the data is prescribed, cannot 
be a characteristic (or have a part which is a characteristic). Indeed, if the solution is 
known at some point on a characteristic, it can be computed at all other points along 
the same characteristic line, and therefore the solution cannot be arbitrarily prescribed 
on this characteristic line. 
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y 


A 


(Xo, Yo) 


o—_—__>__e _________ + X¥ 


Vv X0¥o *o 


Integrating along the characteristic hyperbola. 


8.6.1 Problems. 
1. Solve the problem 


ux + Uy = 1, 
u(x, 0) = e*, 


by using y as a parameter. 
2. Solve the problem 


XU, — Yuy +U=X, 


u=1 ony=x, 


in case the point (x, y) lies in the third quadrant of the xy-plane. 


Answer. u(x, y) = vz + =x — ~y. 


3. Solve for u = u(x, y) 
XU + Yuy +u = x, 


u=1 onthelinex+y=1. 


1 x x 
Answer. u(x, y) = Fae + S aa 


4. Find u = u(x, y), solving 
sin yu, + Uy =X, 


u(x, 0) = x?. 


Hint. Use y as a parameter. Express x as a function of y, when integrating along 
the characteristic curve. 


Answer. u(x, y) = (x + cosy —1)? —siny + ycosy + xy. 
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5. Find the general solution of 


2Uy + Uy = X. 
Hint. Denote by f(x) the values of u(x, y) on the x-axis. 
Answer. u(x, y) = f(x — 2y) + xy — y*, where f is an arbitrary function. 


6. Show that the following problem has no solution: 


2Uy + Uy =X; 


1 2 
u(x, =X) = x’. 
(x, 5x) 
Hint. Compare the data line and the characteristics. 


7. (i) Find the general solution of 
Kuz — Yuy P= x, 


which is valid in the second quadrant of the xy-plane. 


Hint. Let u = f(x) on y = —x, where f(x) is an arbitrary function. 


Answer. u(x, y) = -2f-y=) + 5x + y: 
(ii) Show that the problem above has no solution in the second quadrant. 
8. Solve the problem (here f(y) is an arbitrary function) 
Xux + 2yuy + *u = 0, 


u=f(y) onthelinex =1. 


Answer. u(x, y) = ees) f(2), 


x2 


8.7 Laplace’s Equation: Poisson’s Integral For- 
mula 


A Trigonometric Sum. Let p and a be two real numbers, with 0 < p < 1. Weclaim 
that 
1-7 


1 
2 2(1 —2o cosa +p?) 


2 


We begin the proof by recalling the geometric series: for any complex number z, with 
the modulus |z| < 1, one has 


ce 
+ >) p” cos na = 


n=1 


(8.7.1) 


foe} 
> Zo : : 
a 1-Z 
Consider the complex number z = pe!*. Then |z| = p < 1, and by Euler’s formula 


z” = pneina — o” (cosna + isinna). 
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It follows that 
Rez” = oe" cos na, 


where Re denotes the real part of a complex number. Then 


foe) 


1 1 < 
5 + Dp” cosna = Re s+ D2] 
n=1 n=1 
1 
= a | 
leta2 | 
14+2Z 
=R 
al 


| 1+ pel% 
2 E — pela | 

+Re| + pcosa+ oe | 

2 1—pcosa—ipsina 

= ee 

~ 2(1—2e cosa +p?) 

In the last step we multiplied both the numerator and the denominator by 1—p cos a+ 
io sin a (the complex conjugate of the denominator). 


Laplace’s Equation on a Disc. Recall from Chapter [7 that in order to solve the fol- 
lowing boundary value problem in polar coordinates (on a disc r < R), 


1 1 
AU = Upy + Uy + Ue9 = 0, forr <R,0 <6 < 2z, 


u(R, 0) = f(9), for 0 < 0 < 2z, 


(8.7.2) 


we begin by expanding the given piecewise smooth function f(@) into its Fourier series 
(ee) 
f(@) = ag + > ay, cosné + by, sinnd, 
n=1 


with the coefficients given by 
T 27 
a= xe [Fes 
1 27 
an== | f(p)cosnpas. 
0 
1 27 
b= =f f@)sinnpag, 
0 
The solution of the problem is then 
© ry 
u(r, 0) = ag + a (5) (a, cosn@ + b, sinné@). (8.7.3) 
Recall that this solution represents the steady-state temperatures inside the disc x? + 


y* < R*, provided that the temperatures on the boundary circle x? + y* = R? are 
prescribed by the function f(@). 
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We now substitute the integral formulas for the a,,’s and b,,’s into and denote 
p= = obtaining 


27 
u(r, @) = + | 
0 


Observing that cosn¢cosn@ + sinn¢sinnO = cosn(6 — ¢) and using the formula 
(8.7.1), the sum in the square brackets becomes 

T= og _ R2 == r 
2(1—2ecos(@—¢)+p2) 2(R2—2Rrcos(@ — ¢) +r)" 


ive) 


; +4 >, p” (cos n¢ cos né + sinn¢ sin né) | f(¢)d¢. 
n=1 


1 ioe) 
ae > ep” cosn(@ — ¢) = 
n=1 
We conclude Poisson’s integral formula 
27 
1 R?-?? 
a) al R2 — 2Rrcos(@ — ¢) + r2 Flp)dg, er) 
which gives the solution of the boundary value problem (8.7.2). The function 
R2-r2 


R2—2Rr cos 0+r2 
Recall that solutions of the Laplace equation 


is called Poisson’s kernel. 


Au = Uxy + Uyy = 0 


are called harmonic functions. Poisson’s integral formula implies that one can find a 
harmonic function inside of any disc x? + y” < R?, with arbitrarily prescribed val- 
ues on the boundary of the disc. Poisson’s integral formula is suitable for numerical 
computations. 

Throughout this chapter we consider only the classical solutions, which means that 
u(x, y) has all derivatives in x and y of first- and second-order, which are continuous 
functions. 


8.8 Some Properties of Harmonic Functions 


Setting r = 0 in Poisson’s formula gives the solution at the origin: 


27 270 
uo.) = = [ f@ndd= = [wR dad, 
0 0 


270 


so that u(0,0) is equal to the average of the values of u on the circle of any radius R 
around (0,0). Any point in the xy-plane may be declared to be the origin. We therefore 
conclude the mean value property: the value of a harmonic function at any point (Xo, yo) 
is equal to the average of the values of u(x, y) ona circle of any radius R around the point 
(Xo; Yo): 7 

If a closed curve C encloses a bounded domain D, then we denote D = DUC. 
Dis called the closure of D. One often writes 0D to denote the boundary curve C. It is 
known from calculus that a function u(x, y) continuous on D takes on its maximum and 
minimum values. This means that at some point (x,, y,) € D, u(x,, y,) = maxp u(x, y) 
and u(x, y2) = ming u(x, y), at a point (x2, y,) € D. 


Theorem 8.8.1 (Strong maximum principle). A function u(x, y) which is harmonic in 
a domain D cannot take on its maximum value at points inside D, unless u(x, y) is a 
constant. 
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Proof. Denote M = maxyju(x,y), and assume that u(x9, yo) = M at some point 
(Xo. ¥o) € D. We shall show that u(x, y) = M for all points (x,y) € D. Let the num- 
ber R > 0 be so small that the circle of radius R around the point (x9, yo) lies inside 
D. The values of u(x, y) on that circle are < M, and in fact they have to be equal to 
M, because otherwise their average would be less than M, but that average is equal to 
u(X9, Yo) = M. We conclude that u(x, y) = M, at all points inside of any circle around 
(X9.¥o), Which lies inside D. Now let (x;, y,) be any other point in D. Join (Xo, yo) to 
(x1, y,) by any path in D, and cover that path by small overlapping circles, each lying 
inside D and centered in the preceding circle. Repeating the same argument for all 
circles, we conclude that u(x,,y,) = M. © 


(x1, 1) 


| 

/ 

| 

(Xo, Yo) | 


i 


Overlapping circles joining (x9, yo) to (xj, y,) inside 
D. 


The strong maximum principle has the following physical interpretation: for steady- 
state temperatures (which harmonic functions represent), one cannot have a point in 
D which is hotter than all of its neighbors. 

Similarly, one has the strong minimum principle: a function u(x, y), which is har- 
monic in a domain D, cannot take on its minimum value inside D, unless u(x, y) is 
a constant. So where do harmonic functions assume their maximum and minimum 
values? On the boundary oD. A function harmonic in the entire plane, like u(x, y) = 
x? — y*, has no points of local maximum and of local minimum in the entire plane, but 
if you restrict this function to, say, a unit disc x24 y < 1, then it takes on its maximum 
and minimum values on the boundary x? + y? = 1. 

We shall need the following estimate of the Poisson kernel: 


R2— 7? “ R?-r? _ (R-r)(R+r)_ R+r 
R? — 2Rrcos(@ — ¢) +r? ~ R* — 2Rr +r? (R -r)? R-r’ 
which is obtained by estimating — cos(@ — ¢) > —1 and then simplifying. Similarly, 
R2—/r? R2—r? R-r 


2 ee 
R2 — 2Rrcos(@— ¢)+r2 ~ R2+2Rr+r2 R+r’ 
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which is obtained by estimating — cos(6 — ¢) < 1 and simplifying. Combining, 


Rt R?—?r? R+r 
R+r 7 R*—2Rrcos(@—¢)+r2 — R-r 


Consider again the boundary value problem (8.7.2), and assume that f(¢) > 0, for all 
¢. Using Poisson’s integral formula (8.7.4), we have 


R+ril 
—r27a 


ae 


270 
Lf f@dg <u(r,8) < * [ f(b)d¢. 
0 


By the mean value property, we conclude that for any nonnegative function u(r, @), 
which is harmonic inside x? + y? < R?, the following Harnack’s inequalities hold: 


7 —"u(0,0) < u(r,8) < 5* 


r 
a ~u(0, 0). (8.8.1) 


(The assumption that u(r, 8) > 0 was needed to assure that f(¢) = u(R, $) > 0.) 


Theorem 8.8.2 (Liouville’s Theorem). Ifa function u(x, y) > Ois harmonic in the entire 
plane, then u(x, y) = constant. 


Proof. The estimates (8.8.1) hold for all R. (Observe that f(¢) = u(R, ¢) > 0.) Keeping 
(r, @) fixed, we let R > co in (8.8.1). Then 


u(r, 6) = u(0,0) = constant, for any (r, 8), 


as claimed. © 


Suppose now that a function u(x, y) is harmonic and nonnegative, defined on the 
disc Bg: x7 + y* < R?. We also consider the disc r < R/2 (or x? + y* < R?/4), which we 
denote by Br,2. Using (@ 8.1), we estimate 

R+-R 
7 i 0) = 3u(0, 0). 


max u(x, y) < 
Bria 


Similarly, 

1 
2 
:R 


1 

min u(x, y) > u(0, 0) = =u(0, 0). 
Bro 3 
We conclude that 

MaXgp,, u(x, y) 

ming, U(x,y)~ ” 
for any nonnegative harmonic function, defined on the disc x? + y* < R. This fact re- 
flects the strong averaging property of harmonic functions. (More generally, for each 


bounded domain there is a bound on the ratio of the maximum value over the mini- 
mum value for any nonnegative harmonic function defined on some larger domain.) 
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8.9 The Maximum Principle 


In this section we consider two important classes of functions that include harmonic 
functions. Not all of these functions satisfy the strong maximum principle. We now de- 
scribe a substitute property. Recall that D denotes a bounded domain, with the bound- 
ary C,andD=DUC. 
Theorem 8.9.1 (Maximum principle). Assume that 

Au(x, y) > 0 forall (x,y) € D. (8.9.1) 


Then u(x, y) takes on its maximum value on the boundary, so that 


max u(x, y) = max u(x, y). (8.9.2) 


Functions satisfying the inequality are called subharmonic in D. This theo- 
rem asserts that subharmonic functions take on their maximum values at the boundary 
of the domain. (The possibility that the maximum value is also taken on at points inside 
D is not excluded here.) 


Proof. Consider, first, an easy case when the inequality in is strict: 
Au(x, y) > 0 for all (x, y) € D. (8.9.3) 


We claim that u(x, y) cannot have points of local maximum inside D. Indeed, if (x9, yo) 
€ D was a point of local maximum, then u,,(X%9, Yo) < 0 and uyy(xo, Yo) < 0, and 
therefore 


Au(Xo, Yo) = Uxx(Xo, Yo) + Uyy(Xo, Yo) <9, 


contradicting (8.9.3). It follows that the maximum of u(x, y) on D is achieved on the 
boundary curve C, so that holds, and moreover 


u(x, y) < max u(x, y) for all (x, y) € D. 


Turning to the general case, consider the function v(x, y) = u(x, y) + e(x? + y”), 
with some ¢ > 0. Then 


Av(x, y) = Au(x, y) + 4€e > 0, 


and by the easy case, considered above, 


u(x, y) < v(x, y) < max v(x, y) < max u(x, y) + eK for all (x,y) € D, 


where K is any constant exceeding x? + y” on the bounded closed curve C. Letting 
€ > 0, we conclude that 


u(x, y) < max u(x, y) for all (x, y) € D, 
which implies (8.9.2). © 


The following minimum principle holds for the superharmonic functions, defined 
as the functions satisfying Au(x, y) < 0 on D. 
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Theorem 8.9.2. Assume that 
Au(x, y) <0 forall (x,y) € D. 
Then u(x, y) takes on its minimum on the boundary, so that 


min u(x, y) = min u(x, y). 


Harmonic functions are both subharmonic and superharmonic, and so they as- 
sume their minimum and maximum values on the boundary C. Ifa harmonic function 
is zero on C, it has to be zero on D. (This fact also follows from the strong maximum 
principle.) It follows that the Dirichlet problem for Poisson’s equation 


Au = f(x,y) for (x, y) € D, 
u = g(x,y) for (x,y) EC 


has at most one solution, for any given functions f(x, y) and g(x, y). Indeed, if u(x, y) 
and v(x, y) are two solutions, then their difference u(x, y) — v(x, y) is a harmonic in 
D function, which is zero on C. It follows that u(x, y) — v(x, y) = 0, so that u(x, y) = 
v(x, y) for all (x, y) € D. 

Occasionally one can use the maximum principle to find the maximum value of a 
function on a bounded domain. 


Example 8.9.1. Find the maximum value of u(x, y) = 2x4 — 3xy? + y°+ x? +x-—2y 
on the closed square [0, 1] x [0,1], where 0 < x,y <1. 

Setting the partials u, and wy to zero would lead to an intractable 2 x 2 nonlinear 
system. Instead, we calculate 


Au(x, y) = 24x? + 2— 6x + 30y* > 24x? —6x+2>0, forall (x,y). 


By the maximum principle, the maximum value of u(x, y) occurs at the boundary of 
the square. The boundary of the square consists of four line segments, and on each 
segment u(x, y) is a simple function of one variable. Examining these line segments 
in turn, one sees that the maximum value of u(x, y) is equal to 4, and it occurs at the 
pointx=1,y=0. 

The reasoning behind the maximum principle may be used to analyze some non- 
linear equations. Consider, for example, the Dirichlet problem 


Au=u? for(x,y) €D, 
u=0_ for(x,y) EC. 


This problem has the trivial solution u(x, y) = 0. It turns out that there are no other 
solutions. Indeed, if a solution u(x, y) was positive at some points in D, it would have a 
point of global maximum (x9, yo) € D, with u(x, yo) > 0. At that point, Au(xo, yo) < 
0, while u3(xo, yo) > 0. We have a contradiction to our equation, at the point (Xo, yo), 
which implies that u(x, y) cannot take on positive values. Similarly, one shows that 
u(x, y) cannot take on negative values. It follows that u(x, y) = 0 is the only solution. 


Maximum and minimum principles also hold in the presence of lower-order terms 
(derivatives of the first order). 
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Theorem 8.9.3. Assume that for all (x, y) € D we have 
Au(x, y) + a(x, y)Ux(x, y) + b(x, y)uy(x, y) = 0, (8.9.4) 


where a(x, y) and b(x, y) are given continuous functions. Then u(x, y) takes on its maxi- 
mum value on the boundary C, so that 


max u(x, y) = max u(x, y). 


Proof. Assume, first, that the inequality in is strict. If there was a point of 
maximum (Xp, yo) inside D, then ux(Xo, Yo) = Uy(Xo, Yo) = 0, and Uxx(X, Yo) < 0, 
Uyy(Xo. Yo) < 0. Evaluating the strict inequality at (Xp, Yo), we would have a 
contradiction, proving the theorem in this case. The proof of the general case is similar 
to that for Theorem © 


8.10 The Maximum Principle for the Heat Equa- 
tion 
Recall from Chapter [7 that in case of a bounded interval (0, L), a typical problem in- 
volving the heat equation is 
u, — kuy, = F(x,t), O<x<L, O0<t<T, 
u(x, 0) = f(x), 0<x<lL, 
u(0, t) = a(t), 0<t<T, 
u(L, t) = b(t), 0<t<T, 


(8.10.1) 


with given continuous functions (called the data) F(x, t), a(t), b(t), and f(x) and a 
given constant k > 0. We assume that the final time T < oo. The data is prescribed on 
the parabolic boundary I, which is defined to be consisting of the lines x = 0, x = L (for 
0 <t < T) and the segment 0 < x < L of the x-axis. The solution must be determined 
in the parabolic domain D = (0,L) x (0, T], where 0 < x < Land0 <t < T. We shall 
denote D = DUT. 

Recall from calculus that if a differentiable function v(t), defined on some inter- 
val [0, T], has a local maximum at some fy € (0, T), then v’(tg) = 0, while if a local 
maximum (relative to [0, T]) occurs at T, then v’(T) > 0. 


Theorem 8.10.1 (The maximum principle). Assume that F(x, t) < 0 forall (x,t) € D, 
or 

uz — Kuyx, <0, for all (x,t) € D. (8.10.2) 
Then u(x, t) takes on its maximum value on the parabolic boundary, so that 


max u(x,t) = max u(x, t). (8.10.3) 
D 
(In particular, if u(x, t) < 0 on T, then u(x, t) < 0 on D.) 
Proof. Again, we consider first the case of strict inequality 


u, — kux, <0, for all (x, t) € D. (8.10.4) 


We claim that u(x,t) cannot assume its maximum value at a point (X9,to) in D. As- 
sume, to the contrary, that (xo, to) € D is a point of maximum value of u(x,t). If 
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ty < T, then u,(Xo, to) = 0 and —u,,(X, to) > 0, contradicting the inequality (8.10.4), 
evaluated at (Xo, ty). In case ty = T, we have u,,(Xp,to) < 0, and from we 
get u,(Xo, to) < 0. But then u(Xp, t) is larger than u(Xp, to) at times ¢ a little before fo, 
in contradiction to (Xo, to) being a point of maximum, so that the point of maximum 
value (of u(x, t) on D) occurs on the parabolic boundary I’, and 


u(x, t) < max u(x, t), for all (x, t) € D, (8.10.5) 


which implies (8.10.3). 
Turning to the general case, we denote M = maxy u(x, f), and let u(x, t) = u(x, t)+ 
ex’, with a constant e > 0. Then 


Vz — kvyy = Uz — Kuyy, — 2ke < 0, 
so that strict inequality holds for v(x, t), and then by (8.10.5) 


u(x, t) < v(x, t) < max u(x, t) <M +l? for all (x, t) € D. 


Letting € — 0, we conclude that 
u(x,t) < M, for all (x, t) € D, 
which implies (8.10.3). © 
Similarly, one establishes the following minimum principle. 


Theorem 8.10.2. Assume that F(x, t) > 0 forall (x, t) € D, or in other words, 
u, — kux, > 0 for all (x, t) € D. 
Then u(x, t) takes on its minimum value on the parabolic boundary, and 


min u(x, t) = min u(x, t). 
D Tr 
(In particular, if u(x, t) > 0 on T, then u(x, t) > 0 on D.) 


For the homogeneous heat equation, where F(x, t) = 0, both minimum and maxi- 
mum principles apply. As a consequence, the problem has at most one solution 
(one shows that the difference of any two solutions is zero). 

We have the following comparison theorem. 


Theorem 8.10.3. Assume we have two functions u(x, t) and v(x, t), such that 
Uz — kKuyx, > v;—kvy, inD andu>vontl. 


Then u(x, t) > v(x, t) in D. 


Proof. The function w(x, t) = u(x, t) — v(x, t) satisfies w, — kw,, >0in Dand w > 0 
onT. By the minimum principle w > 0 in D. © 


More information on maximum principles may be found in a nice book of M. H. 
Protter and H. F. Weinberger [24]]. 
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8.10.1 Uniqueness on an Infinite Interval. We begin with discussion of the 
remarkable function 


1 
e @ fort #0, 
0 fort =0. 


This function is positive for t # 0; however, g(0) = 0, and g’(0) = g”(0) = g’”"(0) = 
-- = 0, so that all derivatives at t = 0 are zero. Indeed, 


mp (=O “timo. 


t-0 


g(t) = 


g'(0)= 


Letting 7 =u we evaluate this limit by using l’H6pital’s rule: 


1 
e 2 F ee) ; u 
= lim ue“ = lim — = lim —_; 
t30 uo uc eu u>co 2ueu 


It follows that 

2 -1 

ae 2 fort £0, 
fort =0. 


g(th= 


The derivatives g”(0), g’””(0), and so on, are evaluated similarly. 
The initial value problem on the entire x-axis 
Uz — Uxx = 0 for —co < x < o,t > 0, 
(8.10.6) 
u(x,0) = 0 for —co < x < oo 
has the trivial solution u(x, t) = 0. Surprisingly, this problem also has nontrivial solu- 
tions! Here is one of them: 


_ g(t) yak 
u(x,t) = > ORT * (8.10.7) 
where g(t) is the function just defined. (It is not hard to show that this series converges 
for all x and all t > 0.) Clearly, u(x, 0) = 0, because g(0) = 0 for any derivative k. 
Compute 


© olk)(t © litt) .. 
=2 & | (t) k-2 58 a ae, 
1 (2k — 2)! my (2i)! 
where we shifted the we of summation, k = i, by letting k — 1 =i. 
It follows that the problem 


i=0 


Uz — Uxx = F(x,t) for—c0o <x<o,t>0, 
(8.10.8) 
u(x, 0) = g(x) for —co < x < oo 

has infinitely many solutions, provided that it has one solution. Indeed, to any solution 
one may add a constant multiple of the function in (8.10.7), to get other solutions. 

The function g(t) appears in other counterexamples, or the examples that challenge 
our intuition. For example, the Maclauren series for g(t) is a sum of zeroes, and it 
converges to zero, not to g(t). 

We shall show that the problem has at most one bounded solution, which 
means that |u(x, t)| < M for some constant M > 0 and all —co < x < wo andt > 0. 
This fact will follow immediately from the following theorem. 
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Theorem 8.10.4. Assume that we have a solution u(x, t) of the problem 
uz — kuy, = 0 for-—w <x <0o,t>0, 

(8.10.9) 

u(x, 0) = 0 for —o« <x < 0, 


which is a bounded (for all x and t) function. Then u(x, t) = 0, for all x and t. 


Proof. We are given that |u(x,t)| < M for some M > 0 and all x and t (or —M < 
u(x,t) < M). In the region D : -L< x < L,0 <t < T, with some positive constants L 
and T, we consider the comparison function 
v(x, t) = > (52 + kt). 
One calculates 

LV; — kvy, = 0. 


On the parabolic boundary of the region D we have 


v(x, 0) = ae > 0 = u(x, 0), 


2Mk 
v(+L, t) =M+ a, > M > u(+L, t). 


By the comparison theorem, Theorem 
u(x,t) < v(x,t) in D. 
The function —v(x, t) satisfies 
(—v); — k(—v) xx = 0, 
—v(x,0) = -5x <0=u(x,0), 


2Mk 


Using the comparison theorem, Theorem again, we conclude that 
—u(x, tf) < u(x,t) < v(x,t) inD, 


which gives 


2M /1 
|u(x, t)| < v(x, t) = 77 (5° + kt). 
Letting L > oo here, we conclude that u(x, t) = 0 for any fixed x and t. © 


As a consequence, we have the following uniqueness theorem. 


Theorem 8.10.5. For any given functions F(x, t) and f(x), the problem 


u, — kux, = F(x,t) for-—0<x<o,t>0, 
u(x,0)= f(x) for-—0<x<0© 


has at most one bounded solution. 


Proof. The difference of any two bounded solutions would be a bounded solution of 
the problem (8.10.9), which is zero by the preceding theorem. © 
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8.11 Dirichlet’s Principle 
Recall the concept of divergence of a vector field F = (P(x, y, Z), Q(x, y, Z), R(X, y, Z)) 
divF = V-F = B(x, y,z) + Q(x, y,Z) + Rz(x,y, Z). 
An example of a vector field is given by the gradient of any function w(x, y, z), namely 
Vu = (w(x, y, Z); Wy (x,y, Z), Wz(X, y, 2) One calculates 
div (Vw) = Wx, + Wyy + Wz, = Aw. (8.11.1) 


Suppose that a bounded domain D in (x, y, z) space is bounded by a closed and 
smooth surface S. The divergence theorem reads: 


[ awrav = [P-nas. 
'D S 


Here /f,, denotes the triple integral over D, f, is the surface (double) integral over S,n 
is the unit normal vector pointing outside of D (n is changing from point to point on 
S), F - n denotes the scalar product of two vectors, and dV = dx dydz is the volume 
element. Applying the divergence theorem to (8.11.1) gives 


[ swav = [ve- ndS = [Fes 


where ~ denotes the directional derivative in the direction of n. 
n 
Given two functions u(x, y, z) and v(x, y, z), one calculates 
div (vVu) = Auv + Vu- Vo. 


By the divergence theorem 


[ (Auv + Vu- Vu)dV = [ div(vVu) dV = [ov -nds, 
D D Ss 


or 


[ awav=- [ vu-voav+ [ Moas. (8.11.2) 
D D sn 


This formula is called Green’s identity; it extends the integration by parts formula to 
higher dimensions. 

We now apply Green’s identity to give another proof of the uniqueness of solution 
of the Dirichlet problem for Poisson’s equation. 


Theorem 8.11.1. Given any f(x, y, z) and g(x, y, z), there exists at most one solution of 
the boundary value problem 


Au = f(x, y,z) inD, 


u=g(x,y,z) onS. (8.11.3) 


Proof. Assume that there are two solutions u(x, y, z) and u(x, y,z). Their difference 
w = u — vSatisfies 
Aw=0 inD, w=0 onS. 


We multiply the last equation by w and integrate over D. In view of 


o= [ wawav=- [ vw. vwav+ [ was =- [ ivwpav. 
D D s 9 D 
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(We used that f¢ we dS = 0, because w = 0 on S; |Vw| denotes the length of the 


gradient vector.) It olla that Vw = 0, so that w(x, y, z) is a constant. This constant 
is zero, because of the boundary condition, so that w = u—v = 0, and then u = vin 
D. © 


Dirichlet’s principle says that the solution of the boundary value problem (8.11.3) 
minimizes the following energy functional 


J(u) = [ [5ivur i uf dV 


among all functions satisfying the boundary condition in (8.11.3). (Here |Vu| denotes 
the length of the gradient vector, |Vu|? = Vu- Vu.) 


Theorem 8.11.2. Assume that u(x, y, z) is a solution of (8.11.3). Then 
J(u) = minJ(w), where w = g(x, y,z) on S. (8.11.4) 
W 


Conversely, if u(x, y, Z) satisfies (8.11.4), then it is a solution of the boundary value prob- 


lem @I1.3) 


Proof. Part 1. Ifwisa solution of (8.11.3), then u— w = 0on S. Multiply the equation 
in (8.11.3) by u — w, integrate over D, and use Green’s identity: 


0= [ (auu-w)- fu wyjav = f [-vu- Var w)= flu wav. 
D 


D 
(Observe that /¢ a(u —w)dS = 0.) It follows that 


[livur + uf] av= [(vu-vo+wf v 
D D 


<5 f iurav+ [ [5ivup +us] dv. 
2 ID ID 2 


In the last step we used the Cauchy-Schwarz inequality for vectors Vu-Vw < |Vu||Vw, 
followed by the numerical inequality ab < = a+ ~b?. Rearranging the terms in (8.11.5), 
we conclude that J(u) < J(w) for any w, satisfying w = gon S. 

Part 2. Conversely, assume that u minimizes J(u) among the functions w, satisfying 
w = gonS. Fix any v(x, y, Z), satisfying v = Oon S. Then for any number ¢ the function 
u + ev is equal to g on S, and therefore J(u) < J(u + ev). It follows that the function 
j(€) = Ju + ev) has a minimum at ¢ = 0, and therefore j’(0) = 0. Calculate 


J© 


(8.11.5) 


Il 


J(u + ev) = i [5 (vu + evn) . (Vu + eVv) + (u +60) f] dV 
D 


2 
5 [iverav+e f (u-vorepav+ f (SivuP +uf)av. 
2 D D D 2 
It follows that 
0=/@= [ (u-vo+epav= [aus frody, 
D D 


using Green’s formula in the last step. Since the function v is arbitrary (except for the 
condition v = 0 on S), we conclude that Au = f in D. © 
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One often refers to the functions w satisfying w = g on S as the competing func- 
tions. Among the competing functions one searches for the minimizer of J(u), which 
provides the solution of the boundary value problem (8.11.3). This approach is suitable 
for numerical computations. 


8.12 Classification Theory for Two Variables 


The equation 
p(x, y) =C, (8.12.1) 
where (x, y) is a differentiable function of two variables and c is a constant, defines 
implicitly a function y = y(x). Differentiating using the chain rule gives 
Px(X,Y) + Py(X, y)y'(x) = 0, 
and then 
YQH==_ 4 (8.12.2) 


assuming that 9)(x, y) # 0. 
We wish to find a solution z = 2(x, y) of the following nonlinear first-order PDE: 
a(x, y)z% + B(x, y)ZxZy + c(x, y)z% = 0, (8.12.3) 


with given continuous functions a(x, y), b(x, y), and c(x, y). Similarly to linear first- 
order equations, one needs to solve an ODE. 


Lemma 8.12.1. Assume that the function y(x), which is implicitly defined by p(x, y) = c, 
solves the equation 
72 Ul 
a(x, y)y"” — b(x, y)y’ + c(x, y) = 0, (8.12.4) 
and assume 9,(x, y) # 0 for all x and y. Then z = 9(x, y) is a solution of (8.12.3). 


Proof. Substituting y’(x) = into (8.12.4) and then clearing the denominators 


_ Px 
Py 

gives 
A(x, V)P% + D(X, Y)PxPy + C(x, YP} = 0, 


so that g(x, y) is a solution of (8.12.3). © 


The equation (8.12.4) is just a quadratic equation for y’(x). Its solutions are 


b++vb2 —4ac 


(x) = 12: 
y'(x) Fi (8.12.5) 
One finds y(x) by integration, in case b? — 4ac > 0. 
Example 8.12.1. Find two solutions of 
XZ5, + (X + Y)ZyZy + yz, = 0. (8.12.6) 


The equation takes the form 


dy 2 dy - 
(2) =e y=. 


Solving this quadratic equation gives 


dy _xt+yty(et+y?—4xy  xt+y+(x-y) 


dx 2x 2x 
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tire? _ d ; Bit. 
When we take “plus”, we obtain ~ = lory = x+c. We put this function into an 


x 
implicit form y — x = c, which gives us the first solution z,(x, y) = y — x. In case of 
“minus”, we get 


y 
dx x 
Yee 
x 
z(x,y) = ~. There are other solutions of the equation (8.12.6), for example z3(x, y) = 

x 
c, or the negatives of z,(x, y) and z2(x, y). 
Recall that the wave equation was solved by introducing new variables € and », 
which reduced it to a simpler form. We consider now more general equations 


The solution of this equation is y = cx, or in implicit form. The second solution is 


a(x, y)Uxx + D(X, y)Uxy + C(X, y)Uyy + d(x, yu, + E(x, yuy = 0, (8.12.7) 


with given continuous coefficient functions a(x, y), b(x, y), c(x, y), d(x, y), and e(x, y) 
and the unknown function u = u(x, y). We make a change of variables § = &(x, y) and 
n = (x, y) and look for the twice differentiable functions &(x, y) and n(x, y), which will 
make this equation simpler. We assume that the change of variables is nonsingular, 
meaning that one can solve for x and y as functions of € and n, so that we can go back 
to the original variables after solving the equation in the new variables € and 7. This is 
known to be the case, provided that the Jacobian (or Jacobian determinant) 


J = &ny — Eynx #0, (8.12.8) 
a condition we shall assume to hold. 
Writing 
u(x, y) = u((x, y), n(x, y))s 
we use the chain rule to calculate the derivatives: 
Ux = Urs + UpNxs 
Uy = UpeEZ + Wen EN + Unt + Urey + UgNaxx- 


Similarly 


Uxy = UgeExSy + Wey (ExMy + NxSy) + UgnMxNy + UrSxy + UnNxy> 
Uyy = UgeSy + WWenSyNy + Uy My + UsSyy + UyNyy- 
We use these expressions in to obtain 
Auge + Bugy + Cuyy + --- = 0, (8.12.9) 
with the new coefficient functions 
Az=ak2+ beet Cees 
B = 2a&,n, + b (En, + Gn) + 2cEyny, (8.12.10) 
C = an + byxny + cn, 
and where the terms not shown in involve the first derivatives Ug and Un; the 
lower-order terms. 
The equation will be simpler if one chooses &(x, y) and (x, y) to be the 


solutions of (8.12.3), called the characteristic functions (or characteristics, for short). 
The number of real-valued characteristic functions depends on the sign of 
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b?(x, y) — 4a(x, y)c(x, y) (see (8.12.5)). The equation is called 
« hyperbolic at a point (X9, yo) if b?(X9, yo) — 4A(Xq, Yo)C(Xo, Yo) > 0; 
* parabolic at a point (Xo, yo) if b*(X9, Vo) — 4a(Xp, Yo )C(Xp, Yo) = O, 


- elliptic at a point (Xo, yo) if b*(xXp, Yo) — 4a(Xo, Yo)C(Xo, Yo) < 0. 

In the hyperbolic case, the change of variables € = &(x, y) and yn = n(x, y) makes 
A=C =0, and dividing the equation by B # 0, we obtain the canonical form 
Usn tees 0, 

similarly to the wave equation. 
How did we know that B # 0? This fact follows by the formula 
B? — 4AC = (b? — 4ac)J?, 


which is verified by using the above expressions for A, B, and C. The same formula also 
shows that the type of an equation is preserved by a nonsingular change of variables 
(J # 0). 


In the the parabolic case, when 
b? — 4ac = 0, (8.12.11) 


there is only one characteristic function &(x, y). Choosing § = &(x, y), we make A = 0, 
eliminating one term in (8.12.9). We choose n = 7(x, y), where the function 7(x, y) 
is almost arbitrary, with the only requirement being that the Jacobian J (defined in 


(8.12.8)) is nonzero. Comparing (8.12.5) with and using (8.12.11), 


Pye 
2a Ey 
or 
2aé, + b&, = 0. 
Then 


B= ny (2ak, + b&y) + ny (2cky + bEx) 


= Nyéy (2¢ + be) 


b2 
= Nyéy (2¢ = =) 
_ NySy(4ac — b?) 
- 2a 
=0. 
The result is the canonical form of parabolic equations 
Uny tees 0, 


which is consistent with the heat equation. 

In the elliptic case there are no real characteristic functions; however, there are two 
complex conjugate ones, &(x, y) and &(x, y). Making the change of variables £ = (x, y) 
and n = (x,y), we obtain similarly to the hyperbolic case 


UEn +.--=0. (8.12.12) 
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(The coefficients of the lower-order terms are complex valued, in general.) We now 
make a further change of variables (€,7) — (a, 8): 


which takes into the canonical form for elliptic equations 
Uga + Ugg +++ = 0. (8.12.13) 
The resulting change of variables (x, y) > (a, 6) is real valued, and so the lower terms 
in have real-valued coefficients. 
Example 8.12.2. Let us find the canonical form of the equation 
X7Uxy — YUyy — 2yuy = 0. (8.12.14) 


Here b* — 4ac = 4x7y’, so that the equation is hyperbolic at all points of the xy-plane, 
except for the coordinate axes. The equation (8.12.5) takes the form 


,  £y4x?y? y 
oye EX? 
assuming that xy > 0. The solution of y’ = . is y = cx, or . = c, so that € = The 
solution of y’ = = isy= 2 or xy = c. So that 7 = xy. The change of variables 
Pes = 
s=o = xy 


produces the canonical form of our equation 
1 
Ug, + 3Etn = 0. 


One can now solve the original equation (8.12.14). Setting v = u,, we obtain an ODE 


n? 


1 
with the solution v = € 2F(y), where F(7) is an arbitrary function, so that u, = 


1 1 
€2F(n). Another integration in n gives u = € 2F(n) + G(é), where G(&) is an ar- 
bitrary function. Returning to the original variables, one concludes that u(x,y) = 


x Y\; : 5 7 
Jf 2FOy) + G(=) is the general solution of (8.12.14). 


Example 8.12.3. The equation 


x2 


Uxy — 2XYUzy + YUyy + XU, + yuy = 0 
is of parabolic type for all x and y. The equation (8.12.5]) becomes 


fone 
Lea 


with the general solution y = <. This leads to — = xy, and we choose arbitrarily 7 = y. 
x 


(The Jacobian J = §,.n,—&n, = y # 0, under the assumption that y # 0.) This change 
of variables produces the canonical form 


NUyy + Uy = O. 
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Writing the last equation in the form (nuy ) = 0 and integrating twice in 7, we obtain 


its general solution 
u = F(S) log |n| + G(S), 


with arbitrary functions F(é) and G(). The general solution of the original equation 
is then 


u(x, y) = F(xy)log|y|+G(xy),  fory #0. 


Example 8.12.4. Tricomi’s equation 
Uxx + XUyy = 0 


changes type: it is elliptic for x > 0, parabolic for x = 0, and hyperbolic for x < 0. Let 
us find its canonical form in the elliptic case x > 0. The equation (8.12.5) gives 


y' = tivx, 
De ses a = 208 
ory= 45 ix2 +c. The complex-valued characteristics are § = y+ 5 ix? and € = y— 3ix?. 


3 
= 5: 32 + 
Thena = — = and 6B = aa = y. We have uy = Ug dy, Uxx = Ugg he +Ugtyy = 


1 
122 : 
UgaX +UgsX ?, and uy, = Ugg. The equation transforms as 


1 1 
X (Ugg + Ugg) + 5% Ua = 0, 
which leads to the canonical form 
1 
Uaa + uge + 3q tea =0. 


The wave equation is the main example of hyperbolic equations, the heat equa- 
tion is the best known parabolic equation, and Laplace’s equation is an example, as 
well as the canonical form, for elliptic equations. Our study of these three main equa- 
tions suggests what to expect of other equations of the same type: sharp signals and 
finite propagation speed for hyperbolic equations, diffusion and infinite propagation 
speed for parabolic equations, maximum principles and smooth solutions for elliptic 
equations. These facts are justified in more advanced PDE books; see, e.g., L. Evans 


[9]. 
8.12.1 Problems. 
I. 1. Assume that the function u(x, y) is harmonic in the entire plane and that 
u(x, y) > —12 for all (x, y). Show that u(x, y) is a constant. 
Hint. Consider v(x, y) = u(x, y) + 12. 


2. Assume that the function u(x, y) is harmonic in the entire plane and that 
u(x, y) < 0 for all (x, y). Show that u(x, y) is a constant. 


Hint. Consider v(x, y) = —u(x, y). 


3. Prove that a function that is harmonic in the entire plane cannot be bounded 
from below or from above unless it is a constant. 

4. Assume that the function u(x, y) is harmonic in D and that u(x, y) = 5 on dD. 
Show that u(x, y) = 5in D. 
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R2-r2 
R2-2Rrcos(@—¢)+r2 


Calculate the integral (Re d¢, where R, r, and 6 are param- 


eters. 


Hint. Identify this integral with the solution of a certain Dirichlet problem, 

given by Poisson’s integral formula. 

Let D be the square —1 < x < 1,—-1 < y < 1. Assume that u(x, y) satisfies 
Au=-1 inD, u=OondD. 

Show that ; < u(0,0) < -. 


Hint. Consider v(x, y) = u(x, y) + : (x? + y?) and Av. 


Show that any solution of the nonlinear problem 
Au+w(1—u)=0 inD, u=0 ondD 
satisfiesO <u <1. 


Hint. Show that u(x, y) cannot take on a maximum value that is greater than 
1 and a negative minimum value. 


Let a(x, y) > 0 be a given positive function. Show that the problem 
Au — a(x)u = 0 in D, 
u=0 on dD 
has only the trivial solution u(x, y) = 0. 
Find the absolute maximum of u(x, y) = y* + 2x7y” + x4 — x* + y’ on the disc 
w+y? <4. 
Show that the nonlinear problem 


Au(x, y) + yux(x, y) — 2xuy(x, y) — w(x,y)=0 inD, u=0 ondD 


11. 


12. 


13. 


has no nontrivial solutions. 
Show that the solution of 


Uy — Suz, =X*2+0—-t+1, 0O<x<4, t>0, 


u(x, 0) = 0, 0<x <4, 
u(0,t) =1, t > 0, 
u(4,t) = sint, t>0, 


is positive for0 <x <4,0<t<z. 

Assume that the function u(x, y) is harmonic, satisfying u(0, 0) = Oand u(1, 0) 
= 3. Show that u(x, y) cannot be nonnegative for all (x, y) satisfying x” + y” 
<4. 


Hint. Use the mean value property. 
Assume that the function u(x, y) is harmonic, satisfying u(0, 0) = land u(0, 1) 


= 10. Show that u(x, y) cannot be nonnegative for all (x, y) satisfying x? + y” 
<4. 
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Hint. Use Harnack’s inequality, or (8.8.1). 


14. Assume that u(x, t) satisfies 
Uy — Uxx + c(x, thu > 0 for0<x<L,0<t<T, 
u(x,0)>0, u(0O,t)>0, u(L,t)>0 for0<x<L,0<t<T, 


where c(x, t) is any function satisfying |c(x, t)| < M for all0<x<L,0<t< 
T, and some constant M > 0. Show that 


u(x,t) > 0 for0<x<L,0<t<T. 


Hint. Assume first that c(x, t) > 0, and get a contradiction at any point, where 
u(x, t) assumes a negative minimum. If u(x, t) = e*‘v(x, t), then v(x, t) satis- 
fies 

Vz — Vx + (& + c(x, t)) v = 0, 
and a + c(x,t) > 0, if the constant a is chosen large enough. 


15. Show that there is at most one solution of the nonlinear problem 
U,—Uyx+uw2=0 ~~ for(x,t)€ D=(0,L)x(0, TI, 
if the values of u(x, t) are prescribed on the parabolic boundary I. 


16. (i) Let f(v) be a convex function for all v € R. Assume that g(x) > 0 on 
(a, b) and i. v(x) dx = 1. Prove Jensen’s inequality 


AL 


for any function u(x) defined on (a, b). 


b 
u(x)p(x) ex) < [ F (u(x) ox) dx, 


Hint. A convex function lies above any of its tangent lines, so that for 
any p and q 


f(q) = f(p) + f'(P)a — P). 
Setting here q = u(x) and p= i u(x)p(x) dx, 
b 


b 
Flu(x) =1( i u(x) (2) ex} 4@ jue - [ ux)p(x) tx 


a a 


Multiply both sides by g(x), and integrate over (a, b). 


(ii) Consider a nonlinear heat equation 
U,=Uyx+ flu), O<x<7, t>0, 
u(0, t) = u(z, t) = 0, 
u(x, 0) = uo(x). 
Assume that f(u) is a convex function for all u € R. Assume there is a 


a, so that f(u) — u > 0 foru > a, and i TOE 
u)—-u 


that - So Up(x) sin x dx > u. Show that the solution blows up in finite 
time. 


< oo. Assume finally 
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Hint. Multiply the equation by g(x) = - sin x and integrate over (0, 7r). 
Denote v(t) = : i u(x, t)sinxdx. Integrating by parts twice, we ex- 


press : Uxx(x, t)sinxdx = -* i, u(x, t)sinxdx = —v(t). Apply- 
ing Jensen’s inequality gives 


du 
aa ee 
dt —<_ U as fv), 
r 5 > dt. It follows that u(t) becomes infinite by the time t = 
co §=6. dv 
fa Fa <© 


(iii) Let f(u) = u?, up(x) = 4sinx. Show that the solution becomes un- 
bounded by the time t = In 7 


Hint. Here <= > —v +v? and v(0) = z. 


Il. 1. Find two solutions of 
2; — yzy = 0. 


Answer. z = 24/y —x,andz = 24/y +x. (Also, z = —2fy +x,andz = 
—2,/y — x.) 


2. Show that the change of variables € = &(x, y), n = n(x, y) takes the equation 
a(x, y)Uxx + D(X, y)Uxy + C(X, Y)Uyy + A(x, y)ux + e(xX, y)Uy = 0 
into 
Auge + Bugy + Cuyy + Du; + Eu, = 0, 
with A, B, and C given by and 


D = aéyy + dé y + cbyy + dé, + fy, 
E = anyxx + byxy + Chyy + dx + fny. 


3. Find the canonical form for the equation 


1 
Uxx — WUyy — x Uy =0 


in the upper half-plane y > 0, and then find the general solution. 


Answer. § = 24/y —xandy = 2/y + x leads to ug, = 0, and then u(x, y) = 
F(2\/y — x) + G(2,/y + x). 
4. Show that Tricomi’s equation 
Uxx + XUyy = 0 


is of a different type for x < 0, x = 0, and x > O. For each type find the 
corresponding canonical form. 
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Answer. In case x < 0, this equation is of hyperbolic type, and its canonical 
form is 


1 
Ugn + aE ap ME — Un) = 0. 


5. Find the canonical form for the equation 
X7Uxy + WZYUxy + Y-Uyy + XUy + YUy = 0. 


Hint. The equation is of parabolic type, for all x and y. Calculate € = xy, and 
choose 7 = x (arbitrarily). 


6. (i) Let us revisit the first-order equation 


a(x, y)Ux + D(x, y)uy + c(x, yu = f(x, y). (8.12.15) 
Assume that the function y(x), which is implicitly defined by g(x, y) = 
c, satisfies the equation 

dy _ by) 
dx a(x, y)’ 


Show that the change of variables (x, y) > (&,7), given by € = 9(x, y) 
and 7 = y (chosen arbitrarily), transforms the equation into 


bu, + cu = d. 
(ii) Find the general solution of 


au, + buy = 0, a and b are nonzero constants. 
Answer. u(x, y) = f(bx — ay), where f is an arbitrary function. 


(iii) Find the general solution of 


—XUy + Yuy tu=xX. 


Answer. u(x, y) = ; + cee where f is an arbitrary function. 
y 


Ill. 1. Show that the Neumann problem 


Ou 

an =0 onS 
has no solution if f, f(x, y,z)dV # 0. (Here and in the problems that follow, 
we denote S = OD.) 


2. Show that the difference of any two solutions of the Neumann problem 


Au = f(x,y,z) inD, 


Au = f(x,y,z) inD, ou = g(x,y,z) ons 
is a constant. 
3. Let D be a domain in (x, y, z) space, bounded by a closed and smooth surface 
S, and let n = (n,, 2, n3) denote the unit normal vector on S pointing outside 
of D (n as well as its components n;, nz, and n; are functions of (x, y, z)). 
Consider a vector field F = (u(x, y, z), 0,0), with a continuously differentiable 
function u(x, y, Z). 
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(i) Use the divergence theorem to show that 


[wav = [un ds. 
D Ss 


Derive similar formulas for f,, uydV and for f, u,dV. 
(ii) Show that the nonlinear Dirichlet problem 


Aut+uu,=0 inD, u=0 ons 
has only the trivial solution u = 0. 


: : : : d : 
Hint. Multiply the equation by u, and write u?u, = =u. Then inte- 
x 
grate over D. 


(iii) Let v(x, y,z) be another continuously differentiable function. Derive 
the integration by parts formula 


[wear =- [uvav+ [ wom, dS. 
D D Ss 


Derive similar formulas for f, uyvdV and for f, uzvdV. 
(iv) Show that the nonlinear Dirichlet problem 


Aut+xu?u,=0 inD, u=0 onS 
has only the trivial solution u = 0. 


Hint. Multiply the equation by u, and write u>u,. = ae Then inte- 
x 
grate over D. 


4. Consider a nonlinear boundary value problem 
Au = f(u) inD, 
u=g(x,y,z) ons, 


with an increasing function f(u). Show that there is at most one solution. 
Hint. Let v be another solution. Then 
A(tu-—v)=f(@-—f(v) inD, u-—v=0 ons. 


Multiply by u — v, and integrate over D 


/ |Vu —v)Pdv = — / [f(u) — f(v)] U— v)dVv <0. 
D D 


5. (i) Let Dbea three-dimensional domain, bounded by a closed and smooth 
surface S. Derive the second Green’s identity 


Ou dv 
[ow — Avu)dV = [Se = 5) dS. 


Hint. Interchange u and v in (6.11.2) and then subtract the formulas. 
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(ii) Consider the nonlinear Dirichlet problem 
Au=f(u) inD, u=0 onS. 


Assume that 1 jg increasing for all u > 0. Show that it is impossible 


to have two solutions of this problem satisfying u(x) > v(x) > 0 for all 
xED. 


ftw) _ 0) 


uU Uv 


Hint. Integrate the identity: Auv — Avu = uv ( 


6. Assume that the functions u(x) =u (x1, X2,...,X,) and w(x) =w (xX), X2,..., Xn) 
are twice continuously differentiable, with u(x) > 0. Let &(t) be a continu- 
ously differentiable function. Derive the following Picone’s identity: 


div[é (=) (uVw — wVu)| = §(=) wAw — wAu) + €’ (=)w lv ele 


Numerical Computations 


Easy to use software packages, like Mathematica, provide an effective tool for solving 
differential equations. In this chapter some computational methods are described in 
general and not too much tied to Mathematica, as there are other excellent software 
choices. (However, the author is a Mathematica enthusiast, and hopefully the readers 
will share in the excitement.) Initial value problems (including the case of systems) 
and boundary value problems, both linear and nonlinear, are discussed. The chapter 
concludes with the topic of direction fields. 


9.1 The Capabilities of Software Systems, Like 
Mathematica 


Mathematica uses the command DSolve to solve differential equations analytically (by 
a formula). This is not always possible, but Mathematica does seem to know the solu- 
tion methods that we studied in Chapters [I] and | For example, to solve the equation 
y' =2y-—sin’x, y(0) = 0.3, (9.1.1) 
we enter the commands 
sol = DSolvel{y'[x] == 2 y[x] - Sin[x]“2, y[0] == .3}, ylx], x] 


z[x_] = ylx] /. sol[[1]] 
Plot[z[x], {x, 0, 1}] 


Mathematica returns the solution y(x) = —0.125 cos 2x + 0.175e?* + 0.125 sin 2x + 0.25 
and plots its graph, which is given in Figure 

If you are new to Mathematica, do not worry about its syntax now. Try to solve 
other equations by making the obvious modifications to the above commands. 

If one needs the general solution of this equation, the command is 


DSolvel[y'[x] == 2y[x] - Sin[x]°2, ylx], x] 
Mathematica returns 


yx) > e?*c[1] + 5(—Cosl2x] + Sin[2x] + 2). 
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0.55 


Figure 9.1. The solution of the equation (Q.1.1). 


Observe that c[1] is Mathematica’s way to write an arbitrary constant c and that the 
answer is returned as a “replacement rule” (and that was the reason for an extra com- 
mand in the preceding example). Equations of second (and higher) order are solved 
similarly. To solve the resonant problem 


y” +4y=8sin2t, y(0)=0, y'(0) =-2, 


we enter 
DSolve[fy''[t]+4y[t] == 8 Sin[2t], y[0]==0, y'[0] == -2}, yl[t], t] 
// Simplify 
and Mathematica returns the solution y(t) = —2tcos 2t, which involves unbounded 
oscillations. 


When we try to use the DSolve command to solve the nonlinear equation 
y’ = 2y3 — sin’ x, 
Mathematica thinks for a while, and then it throws this equation back at us. It cannot 
solve it, and most likely nobody can. However, we can use Euler’s method to compute a 


numerical approximation of the solution if an initial condition is provided; for example, 
we can find a numerical solution of 


y =2y3—sin’x, y(0) = 0.3. (9.1.2) 


Mathematica can also compute the numerical approximation of this solution. Instead 
of Euler’s method it uses a much more sophisticated method. The command is 
NDSolve. We enter the following commands: 


sol = NDSolve[{y' [x] == 2y[x]*3-Sin[x]%*2, y[0] == .3}, y, {x, 0, 3}] 
z[x_] =y[x] /. sol[[1]] 
Plot[z[x], {x, 0, 1}, AxesLabel > {"x", "y"}] 


Mathematica produced the graph of the solution, which is given in Figure 9.2. 
Mathematica returns the solution as an interpolation function, which means that af- 
ter computing the values of the solution at a sequence of points, it joins the points on 
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the graph by a smooth curve. The solution function (it is z(x) in our implementation) 
and its derivatives can be evaluated at any point. The computed solution is practically 
indistinguishable from the exact solution. When one uses the NDSolve command to 
solve the problem and then plots the solution, the resulting graph is practically 
identical to the graph of the exact solution given in Figure 


l —a n L 1 xX 
0.2 04 0.6 08 1.0 


Figure 9.2. The solution curve of the equation 


(9.1.2). 


In2t}j:= Clear["~*"] 
sol = 


NDSolve[{{x'[t] = -y[t] +y[t]*2, y'[t] =x[t]}, (*[0] = 0.2, y[0] =0.3}}, (x, y}, {t, 0, 20}] 


Outf2zj= { {x > InterpolatingFunction[{{0., 20.}}, <>], y > InterpolatingFunction[{{0., 20.}}, <>]}} 


Inf24:= ParametricPlot[{x[t] /. sol[[1,1]], y[t] /. sol[[1, 2]]}, {t, 0, 20}] 


04 
03 
0.2 


0.1 


Out[24]= 


-03 -0.2 -0.1 


-0.1 


-0.2 


Figure 9.3. The solution of the system (@.1.3). 
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The NDSolve command can also be used for systems of differential equations. For 
example, let x = x(t) and y = y(t) be solutions of 


x’ =-yt+y*, x(0)=0.2, 
y' =X, y(0) = 0.3. 


Once the solution is computed, the solution components x = x(t), y = y(t) define a 
parametric curve in the xy-plane, which we draw. The commands and the output are 
given in Figure 9.3, (The first command tells Mathematica to “forget everything.” This 
is a good practice with heavy usage.) If you play with other initial conditions, in which 
|x(0)| and |y(0)| are small, you will discover that the rest point (0, 0) is a center, meaning 
that the solutions near (0, 0) are closed loops. 


(9.1.3) 


9.2 Solving Boundary Value Problems 


Given the functions a(x) and f(x), we wish to find the solution y = y(x) of the follow- 
ing boundary value problem, on some interval [a, b]: 


y" +a(x)y=f(x), a<x<b, 


(9.2.1) 
y(a) = y(b) = 0 
The general solution of the equation in is, of course, 
V(x) = YX) + cry x) + Coal), (9.2.2) 


where Y(x) is any particular solution and y,(x), y(x) are two solutions of the corre- 
sponding homogeneous equation 


y” +a(x)y =0, (9.2.3) 


which are not constant multiples of one another. To compute y,(x), we use the 
NDSolve command to solve the homogeneous equation (9.2.3), with the initial con- 
ditions 


y(a=0, yal. (9.2.4) 
To compute y,(x), we solve (9.2.3), with the initial conditions 
ya(b) = 0, y3(b) = —1. (9.2.5) 


(Mathematica has no problem solving differential equations “backward” on (a, b).) Ob- 
serve that the values of y|(a) and y,(b) could have been replaced by any other nonzero 
numbers. To find a particular solution Y(x), we may solve the equation in (9.2.1), with 
any initial conditions, say Y(a) = 0, Y’(a) = 1. We have computed the general solution 
(9.2.2). It remains to pick the constants c, and c, to satisfy the boundary conditions. 


Using @.2.4), 
y(a) = Y(a) + Cy, (@) + y2(a) = Y(a) + C2y2(a) = 0 


so that c, = = We assume here that y,(a) # 0; otherwise, our problem (9.2.1) is 


y2 
not solvable for general f(x). Similarly, using (9.2.5), 


y(b) = Y(b) + 1 y1(b) + Cry2(b) = ¥(b) + yi (b) = 0, 
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Clear["~*"] 
lin := 
Module|{s1, s2, 83, yl, y2, Y}, 
sl = NDSolve[{y'' [x] +a[x] y[x] == 0, y[0] = 0, y’[0] +1}, y, {x, 0, 1}]; 
s2 = NDSolve[{y'' [x] +a[x] y[x] = 0, y[1] = 0, y’[1] =-1}, y, {x, 0, 1}]; 
s3 = NDSolve[{y'' [x] + a[x] y[x] = £[x], y[0] = 0, y’[0] =1}, y, {x, 0, 1}]; 
yi[x_] =y[x] /- si[[1]]; 
y2[x_] =y[x] /- s2[[1]]; 
¥[x_] =y[x] /- s3[[1]]; 


z[x_] :=Y¥[x] - 


y1[x 
y1[1] y2[0] 


y2[x] ; 


Figure 9.4. The solution module for the problem 
(9.2.1). 


a[x_] =e*%x; 

f£[x_] =-3x+1; 

lin 

Plot[z[x], {x, 0, 1}, AxesLabel > {"x", "z"}] 


Figure 9.5. Solving the problem (@.2.6). 


giving c, = ae , assuming that y,(b) # 0. The solution of our problem (Q.2.1) is 


yi(b)’ 
then 
Y(b) Y(a) 


yx) = ¥(x) - ao x)- NC pape x). 


Mathematica’s subroutine, or module, to produce this solution, called lin, is given in 
Figure 9.4. We took a = 0 and b = 1. 

For example, entering the commands in Figure 9.5] produces the graph of the so- 
lution for the boundary value problem 


yp" +ey=-3x4+1, O0<x<1,  y(0)=y(1) =0, (9.2.6) 


which is given in Figure 9.4 


02 04 06 08 10 


Figure 9.6. Solution of the problem (0.2.6). 
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9.3 Solving Nonlinear Boundary Value Problems 


Review of Newton’s Method. Suppose that we wish to solve the equation 
f(x) = 0, (9.3.1) 
with a given function f(x). For example, in case f(x) = e?* — x — 2, the equation 
e* —_x-2=0 


has a solution on the interval (0,1) (because f(0) = —1 < O and f(1) = e* —1> 0), but 
this solution cannot be expressed by a formula. Newton’s method produces a sequence 
of iterates {x,,} to approximate a solution of (9.3.1). Ifthe iterate x, is already computed, 
we use the linear approximation 


f(x) = f(x,) + f’On)(x —x,), for x close to x). 
Then we replace the equation (9.3.1) by 
fn) ag Imes les — Xn) =0, 


solve this linear equation for x, and declare its solution x to be our next approximation, 


so that 
Xn41 =%Xy,- Ln) n=1,2,.., beginning with some xp. 
f'n) 
Newton’s method does not always converge, but when it does, the convergence is usu- 
ally super fast. To explain that, let us denote by x* the (true) solution of (9.3.1). Then 
|x, — x*| gives the error of the approximation on the nth step. Under some mild condi- 


tions on f(x), it can be shown that 
IXn41 ~ x*| < c|Xpn ~ al 


with some constant c > 0. Let us suppose that c = 1 and |xp — x*| = 0.1. Then the 
errors of approximation are estimated as follows: |x; — x*| < |xp — x*|* = 0.1? = 0.01, 
|x2 —x*| < |x; —x*|* < 0.017 = 0.0001, |x3 — x*| < |x. —x*|? < 0.0001? = 0.00000001. 
We see that x3 is practically the exact solution! 


A Class of Nonlinear Boundary Value Problems. We wish to solve the nonlinear 
boundary value problem 


y”’+g(y)=e(x), a<x<b, 
y(a) = y(b) = 0, 
with given functions g(y) and e(x). 
We shall use Newton’s method to produce a sequence of iterates {y,,(x)} to approxi- 
mate one of the solutions of (9.3.2). (The problem may have multiple solutions.) 


We begin with some initial guess yo(x). If the iterate y,,(x) is already computed, we use 
the linear approximation 


(9.3.2) 


8(Y) © Bn) + 8’ On — Yn) 
and replace with the linear problem 
¥" + 8Vn@)) + 8'OnQMOY — Yn(%)) = ex), a<x<b, 


y(a) = y(b) = 0. (9.3.3) 
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The solution of this problem we declare to be our next approximation, y,4,,(x). We 


rewrite (9.3.3) as 


y" +a(x)y=f(x), a<x<b, 
y(a) = y(b) = 0, 


with the known functions 


a(x) = g'Wn(*)), 
FO) = —8On@)) + 8'OnQ)) Yn) + eX), 


and call on the procedure lin from the preceding section to solve (9.3.3) and produce 
Yn41(x). If the initial guess yo(x) is chosen not too far from one of the actual solu- 
tions, then four or five iterations of Newton’s method will usually produce an excellent 
approximation! 


Example 9.3.1. We solved the nonlinear boundary value problem 


y’+y? =2sin4dzx—x, O0<x<1, 


yO) = (1) = 0. i 
The commands are given in Figure 9.7, (The procedure lin has been executed before 
these commands.) We started with yo(x) = 1 (yold[x]= 1 in Mathematica’s code). We 
did five iterations of Newton’s method. The solution (the function z[x]) is plotted in 
Figure 9.8), 

The resulting solution is very accurate, and we verified it by the following indepen- 
dent calculation. We used Mathematica to calculate the slope of this solution at zero, 
z' [0] ~ 0.00756827, and then we solved the equation in (0.3.4), together with the initial 
conditions y(0) = 0, y’(0) = 0.00756827 (using the NDSolve command). The graph of 
this solution y(x) is identical to the one in Figure 9.8. 


e[x_] = 2Sin[4 7x] - x; 

yold[x_] =1; 

gly_] =y*3; 

st = 5; 

For[i=1, i < st, i++, 

a[x_] = g'[yold[x]]; 

f[x_] = e[x] - g[yold[x]]+ g'[yold[x]] yold[x] ; 
lin; 

yold[x_] =z[x]; 

] 


Figure 9.7. Solving the problem (9.3.4). 
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02 04 + 06 08 1.0 


Figure 9.8. Solution of the nonlinear problem 


(9.3.4). 
9.4 Direction Fields 


The equation (here y = y(x)) 
y’ =cos2y+2sin2x (9.4.1) 


cannot be solved analytically (like most equations). If we add an initial condition, we 
can find the corresponding solution, by using the NDSolve command. But this is just 
one solution. Can we visualize a bigger picture? 

The right-hand side of the equation gives us the slope of the solution passing 
through the point (x, y) (for example, if cos 2y + 2sin2x > 0, then the solution y(x) 
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Figure 9.9. The direction field for the equation 
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y 


Figure 9.10. The solution of the initial value prob- 


lem (9.4.2). 


is increasing at (x, y)). The vector (1, cos 2y + 2 sin 2x) is called the direction vector. 
If the solution is increasing at (x,y), this vector points up, and the faster the rate of 
increase, the larger the amplitude of the direction vector. If we plot the direction vectors 
at many points, the result is called the direction field, which can tell us at a glance how 
various solutions are behaving. In Figure 9.9, the direction field for the equation 
is plotted using Mathematica’s command 


VectorPlot[{1,Cos[2y]+2Sin[2x] },{x,0,6.5},fy,0,5 }]. 
The reader should also try Mathematica’s command 

StreamPlot[{1,Cos[2y]+2Sin[2x] },{x,0,6.5},fy,0,5 }], 
which draws a number of solution curves of (9.4.1). 

How will the solution of (9.4.1), with the initial condition y(O) = 1, behave? Imag- 
ine a particle placed at the initial point (0, 1) (see Figure 9.9). The direction field, or 
the “wind”, will take it a little down, but soon the direction of motion will be up. After 
a while, a strong downdraft will take the particle much lower, but eventually it will be 
going up again. In Figure we give the actual solution of 

y' =cos2y+2sin2x, y(0)=1, (9.4.2) 
produced using the NDSolve command. It confirms the behavior suggested by the di- 
rection field. 


Appendix 


A.1 The Chain Rule and Its Descendants 
The chain rule 
£ fe) = f'(g(x))g'(x) 


allows us to differentiate the composition of two functions f(x) and g(x). In particular, 
if f(x) = x” with a constant r, then f’(x) = rx’—!, and we conclude 


d -15, 
Fz IsCoy" = rise] 8’), (A.1.1) 
the generalized power rule. In case f(x) = e*, we have 
d 
— e8(*) = e8(X) 5! 
ae e&) 9'(x). (A.1.2) 
In case f(x) = Inx, we get 
d _ g(x) 


These are children of the chain rule. These formulas should be memorized separately, 
even though they can be derived from the chain rule. If g(x) = ax, with a constant a, 


then by 
d ax ax 
a 


This grandchild of the chain rule should be also memorized separately. For example, 


f o-x =-e™%, 


The chain rule also lets us justify the following integration formulas (a and b are 


constants): 
dx 1 1X 
—>—j = — tan —+¢, 
x2+a% a a 


| Zs dinjax +l +c, 


ax+b ~G 
ip six) dx = In|g(x)| +c. 
g(x) 


The situation is similar for functions of two or more variables. If u = u(x, y), while 
x = x(t) and y = y(t), then w is really a function of t and 


du _,, OX dy 
dt “dt ‘dt’ 


(A.1.4) 
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where uw, and uy, are the partial derivatives. If y = y(x), it follows that 
du 
dx 

The equation (c is a constant) 


y 
=Uu,+Uu ie 


u(x,y)=c 


defines implicitly a function y = y(x). Differentiating this equation, we have 
dy 
uy + Uys = 0, 
which gives the formula for implicit differentiation: 


dy __ux(x,y) 


dx ~~ uy(ey)’ 


Ifu = u(&,n), while € = &(x, y) and 7 = n(x, y), then is adjusted to give 
dus On Ou o€ on 
ae eae ae ay “Say + Un3y: 
Ifu = u(x) and x = x(t, s), then 
du ,dx du , OX 
ot ; 
For example, if u(t,s) = f(t — 2s), where f is some function of one variable, then 
u, = f'(t — 2s), uy, = f(t — 2s), us = —2f'(t — 2s), uss = 4f"(t — 25), so that u(t, s) 
satisfies the wave equation 


Utgt = Auss = 0. 


A.2 Partial Fractions 


This method is needed for both computing integrals and inverse Laplace transforms. 


We have 
x+1 x+1 A B 


x24+x-2° (x—-1)(x4+2) — yo1 F40° 
The first step is to factor the denominator. We now look for the constants A and B so 
that the original fraction is equal to the sum of two simpler ones. Adding the fractions 
on the right, we need 


x+1 _ A(x + 2) + B(x — 1) 
(x-1(x+2) (x-1(x+2) ¢ 
Both fractions have the same denominator. We need to arrange for the numerators to 
be the same: 
A(x+2)4+Bax-1)=x+1, 
(A+B)x+2A-B=x+1. 
Equating the coefficients of the two linear polynomials gives 
A+B=1, 
2A—B=1. 
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We calculate A = =, B= =. Conclusion: 
x+1  — 2/3 mn 1/3 
x24+x—-2 x-1 x+2° 
Our next example, 
?-1 stl _A, Bst+c 
S+s+s s(s?t+s4+1) ss s2+s4+1’ 
involves a quadratic factor in the denominator that cannot be factored (an irreducible 
quadratic). Adding the fractions on the right, we need 
A(s* +5+1)+s(Bs+C)=s?-1. 


Equating the coefficients of the two quadratic polynomials, we get 


A+B=1, 
A+C=0, 
A=-1, 
so that A = —1, B = 2,C = 1. Conclusion: 
sl 1 2s+1 


=-=+ ; 
S+s2+58 s st@+s+1 


The denominator of the next example, involves a product of a square 


(s+3)2(s?-+43)’ 


of a linear factor and an irreducible quadratic. The way to proceed is: 
i eee ree re) 
(s+ 3)2(s?+3) s+3 (s+3)2 8243 
As before, we calculate A = -<, B= -<, C=D= =. Conclusion: 
s-l1 1 1 S+1 


(4+3)2(243) 14643) 3s+3) 12043) 


A.3 Eigenvalues and Eigenvectors 


The vector z = t is very special for the matrix B = ae 


—] 1 3 


ef LLL 


so that Bz = 2z. We say that z is an eigenvector of B, corresponding to an eigenvalue 2. In 
general, we say that a vector x # Ois an eigenvector of a square matrix A, corresponding 
to an eigenvalue A if 


} We have 


Ax =<Ax. (A.3.1) 
0 
If A is 2 x 2, then in components an eigenvector must satisfy x = 2 # 0 } In 
2 
xX} 0 
case A is3 x3, then weneedx =] x, |#] 0 
X3 0 


Ifc 4 Ois any constant, then 
A (cx) = cAx = cAx =A (cx), 
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which implies that cx is also an eigenvector of the matrix A, corresponding to the eigen- 


1]. : : 
1 gives us the eigenvectors of the matrix B above, corre- 


sponding to the eigenvalue A = 2. 
We now rewrite ((A.3.1) in the form 


(A-ADx =0, (A.3.2) 


value A. In particular, c 


where I is the identity matrix. This is a homogeneous system of linear equations. To 
have nonzero solutions, its determinant must be zero: 


|A —Al| = 0. (A.3.3) 


This is a polynomial equation for A, called the characteristic equation. If the matrix A 
is 2 x 2, this is a quadratic equation, and it has two roots, A, and A. In case A is 3 x 3, 
this is a cubic equation, and it has three roots, 2,, 2,, and A3, and so on for larger A. To 
calculate the eigenvectors corresponding to 7,, we solve the system 

(A-A,Dx=0 


and proceed similarly for other eigenvalues. 


Example A.3.1. Consider B = : ; } 


The characteristic equation 


3-A 1 
1 3-A 


has the roots 2, = 2and A, = 4 (because 3 —A = +1,A = 3+1). We already know that 


IB ar =| |= @-a?-1=0 


1 : ; 
the vectors c 1 are the eigenvectors for A, = 2, so let us compute the eigenvectors 


for A, = 4. We need to solve the system (A — 4I) x = 0 for x = a } which is 
2 
xX, + X2 = 0, 
X; —X, =0. 
The second equation is superfluous, and the first one gives x; = xX. If we let x, = 


1 
1, then x; = 1 so that 


ie ee ; 
1 | and more generally | 1 | gives us the eigenvectors 


corresponding to A, = 4. 

If an eigenvalue 2 has multiplicity two (it is a double root of the characteristic 
equation), then it may have either two linearly independent eigenvectors or only one. 
In the case there are two, x, and x2, then Ax, = Ax, and Ax, = Ax), and for any 
constants c, and c, 

A (Cy X1 + C2X2) = CyAXy + CpAXz = CYAX, + CoAX2 =A (C1 X] + C2X2), 


so that c,x, + c)xX2 is an eigenvector corresponding to A. 


211 
Example A.3.2, A=] 1 2 1 
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The characteristic equation 


2-A 1 1 
1 2-a 1 = —/3 + 672-9144=0 
1 1 2-A 


is a cubic equation, so we need to guess a root. Here A, = 1 is a root. We then factor 
B62? +91 -4= (A-1)(#? - 5A +4). 
Setting the second factor to zero, we find the other two roots, A, = land A3 = 4. 
Turning to the eigenvectors, let us begin with the simple eigenvalue 2; = 4. We need 
xy 
to solve the system (A —4I)x =Oforx =] x2 J, or 
X3 
—2X, +X2+X%3= 0, 
X1 — 2X, +x3=0, 
X1 + Xz — 2x3 = 0. 
The third equation is superfluous, because adding the first two equations gives the 
negative of the third. We are left with 
—2X, +X2+X%3= 0, 
X, — 2X, +X3=0. 
There are more variables to play with than equations to satisfy. We are free to set x3 = 1 
and then solve the system for x, and x2, obtaining x, = 1 and x, = 1. Conclusion: the 
1 
vectorsc} 1 | are the eigenvectors corresponding to A; = 4. 
1 
To find the eigenvectors of the double eigenvalue A, = 1, one needs to solve the 
system (A —I)x = 0, or 
Xy + X24+X3= 0, 
Xy + X24+X3= 0, 
Xy + X24+X3= 0. 
Discarding both the second and the third equations, we are left with 


Xp +X,+X3=0. 


Now both x, and x; are free variables. Letting x, = 1 and x, = 0, we calculate x, = —1, 
—1 
so that O | is an eigenvector. Letting x; = 0 and x, = 1 gives x, = —1, so that 
1 
—1 


1 | is an eigenvector. Conclusion: the linear combination, or the span, of these 
0 
eigenvectors 
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with arbitrary constants c, and c, gives us all eigenvectors, corresponding to A, = 1, or 
the eigenspace of A, = 1. 
1 4 


For th trix A = 
or the matrix Be _7 


} the eigenvalues are equal, A; = A, = —3, but 


there is only one linearly independent eigenvector: c a 


A.4 Matrix Functions and the Norm 


If A(t) is an m X n matrix with the entries Ajj, i = 1,2,..,m, j = 1,2,...,n, with 


the entries depending on ¢, it is customary to write A(t) = [a;;(t)]. The transpose 


matrix is then A’(t) = [a ji]. The derivative matrix A’(t) = lim, +o eon = 


h 
[limy,_,o ea eased = [aj i] is computed by differentiating all of the entries. Cor- 
respondingly, f A(t) dt = [f a;;(¢) dt]. Clearly, 

d T _ ’ T 

SAO = AO): 


If it is admissible to multiply the matrices A(t) and B(t), then using the product rule 
from calculus, one justifies the product rule for matrices 


< [ABW] = A'(HBO) + A(B'(0). 


x ; 
Let x = a be any constant vector. Consider 
2 
_| cost —sint xX} 
Y=! sint cost X, | 
The vector y is the rotation of the vector x by an angle t, counterclockwise. Changing 


cost sint || pat 


. is the result of rotation 
—sint cost Xz 


t to —t, one concludes that the vector | 


of x = | is by an angle t clockwise. 
2 


If x = (X1, X2,..., Xn)" and y = (yy, y2,-. ar are two n-dimensional vectors, then 
the scalar (inner) product is defined as 


n 
(x,y) = XY + Xay2 $0 + Xn = Dy Xi: 
=k 
The norm (length) of an n-dimensional vector x is defined by 
n 
lll? = (x, x) =D) x7. 
i=1 


The Cauchy-Schwartz inequality states: 
(xy) S |lllllyll- 


IfA is ann Xn matrix, then 
(Ax, y) = (x, ATy). 
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Let A be ann Xn matrix, given by its columns A = [C,C,...C,,]. (C, is the first column 
of A, etc.) Define the norm ||A|| of A as 


n n 
|A|/? = >; He = yD ee 


i=) j=) 
Clearly, 
|a;;| < ||A|], for alli and j. (A.4.1) 
If x = (X41, X2,.., Xn)» we claim that 
[Ax] < IIA III. (A.4.2) 
Indeed, using the Cauchy-Schwartz inequality, 
= n n n 
wast? = 3 (Says) <3 (S05 Sf) 
i=1 \je=1 p14 ja) j=l 
n n 
= |Ixl? D7 Dy a7 = IAI lll. 
i=1 j=1 


Let B be an n x n matrix, given by its columns A = [K,K,...K,,]. Recall that AB = 
[AK, AK, ...AK,]. (AK; is the first column of the product AB, etc.) Then, using (A.4.2), 


||AB||? = YAK < IAI? Y IKI? = AIP (BI, 
which implies that 
|ABl| < IA IIB II. 


Similar inequalities hold for arbitrary number of matrices, which are not necessarily 
square matrices. For example, if a product ABC of three matrices is defined, then 


|ABC|| < |IATIIIBIIICI- 
Similarly one proves the inequalities like 
JA +B+Cl| <|lAll + |IBIl + ICI (A.4.3) 


for an arbitrary number of matrices of the same type. The inequalities (A.4.1) and 
imply that the exponential of any square matrix A, 


al 
= — Ar 
2 id 


is convergent (in each component). Since the integral of a matrix function B(t) is the 
limit of its Riemann sum, it follows that 
ty 
<[ ieelar 
t 


ty 
i B(t) dt 
t 1 
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